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FOREWORD 



This manual introduces the reader to q collection or bank of reading objectives 
devised to aid school personnel in planning, conducting, and evaluating instructional 
programs. The manual describes the nature of the objectives, suggests specific proce- 
dures for their use in curriculum development, and discusses their implications for 
instruction and evaluation. The objectives themselves are contained in tv/o other publi- 
cations: SPPED Resource 5000: Generic Objectives for the Bank o f Objectives, Items , 
and Resources in Reading and SPPEP Resources 5001; Criterion Objectives for the Bark 
of Objectives, Items, and Resources in Reading. 

SPPED, the project of which the reading objectives are a component, is a 
System for Pupil and Program Evalua tion and Dev e lopment. The purpose of SPPED is to 
improve educational decision making and instructional management by focusing 
attention on the intended outcomes of instruction, by fostering evaluation procedures 
that relate measurement and objectives, and by applying computer technology to quicken 
and simplify planning, management, and evaluation tasks. 

The overall SPPED project, including the bank of reading object! /es, was 
conceptualized by and is under the direction of Robert P. O'Reilly, chief cf the Bureau 
of School and Cultural Researcho The reading objectives and some related '•naterials 
were prepared by the Educational Systems Division of Random House woritirg 5n 
conjunction with State Education Department staff. So Alan Cohen wos tne project- 
director and John Bednarik the assistant project director at Random Houseo This manual 
was written by the staff of the Bureau of School and Cultural Research with Howard 
Berkun, Robert O'Reilly, David Rosen, Ruth Salter, and Martha Zakis contributing. 

The reading bank is the product of close cooperation between the Bureau of 
School and Cultural Research and the Bureau of Reading Education. Jane Algozzine, 
chief of the Reading Bureau, participated in the planning and serves as a project 
director* Frances Morris, associate in reading education, lias had a major role in the 
editing and review of the objectives. Ruth Salter, associate in education research, 
deserves special commendation tor integrating the activities of the two bureaus and for 
her editorial and monitoring efforts in bringing the objectives and the manual to their 
current level of development. 

Both the objectives and the manual are developing resources that will be 
modified and refined over time. Their initial use in the schools is to be experimental 
with definite provisions for followup by the Bureaus of Reading Education and School 
and Cultural Research. School personnel are urged to approach the objectives and the 
manual with this in mind and to regard them as starting points for Iheir own efforts — 
creative efforts that will be shared with fellow educators throughout the State. Above 
oil , it should be remembered thot the SPPED Bank of Reading Objectives is a resource 
to be adapted and modified by local schools to meet their local needs 

Carl E. Wedekind 
Director of Research 
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CHAPTl^R 1 



INTRODUCTION 

SPPED is a System for Pupil and Program Evaluahon and Development. Its purpose 
IS to improve educational decision making and instructional management by focusing 
attention on the intended outcomes of instruction, by fostering evaluation procedures 
that relate measurement and objectives, and by applying computer technology to quicken 
planning and evaluation tasks. 

The simple concept underlying SPPED Js that if you determine the goals of your 
instructional program, clearly specifying jusi' what it is you want students to do, and if 
you then test students with items based on the goals or objectives, you will know whether 
or not you are achieving what you set out to accomplish. 

The major components of the SPPED system which are now available or planned are: 

1 P Banks or collections of objectives, test items, and resources 
or references to instructional materials. 

2o Comprehensive Achievement Monitoring (CAM) and mastery 
testing, two approaches to evaluation using criterion- 
referenced testing o 

3o Training manuals for perscnnel aj all levels of instructional 
managemento 

4« Computer programs for accassirg and refining the banks, 
for test scheduling, and for reporting test results in a 
variety of ways. 

r 

In this developing system, the Bank of Reading Objectives is ready for extended 
field usee The purpose of this training manual is to assist school personnel in using the 



bank for planning, installing, and managfng objectives-based reading programs to meet 
the needs of local students. The manual explains the background and contents of rhe 
bank and suggests procedures for its use in the three major aspecrs of a reading program — 
curriculum, instruction^ and evaluation* 

In this first chapter, we will present the rationale for a Bank of Objectives, Items, 
and Resources (BOIR); tell how the bank reading objectives, the portion of the Reading 
BOIR wiiich has been ccmpfe -ed, came into being; and describe the levels system used 
for the ban!< . Succeec"Lng chapters will describe the reading objectives in detail and 
mil disctizs the processes involved in establishing a local curriculum, organizing 
instruction, designing and selecting appropriate cnstructionai materials, and using 
evaluation for the manage^nent of instruction. 

The Rationale for SPPED Banks 

The rationale — the very necessity — for having centralized resources or banks of 
objectives, it-^ms^cnd resources is a matter of time, energy, and money. Why this is 
so will be clear when one considers the contents of the banks* 

The objectives in the SPPED banks are behavioral objectives^ A behavioral 
objective is a precise statement of desired pupil behavior; it specifies the conditions, 
including the type of material^ to which a student will be expOiTed, the response activity 
he will perform under those conditions, and the proficiency he will attain. 

This is a behavioral objective: 

Given a short story such as "Stolen Day" by 
Sherwood Anderson^ the student will read the 
story and list the chief characters and the main 
events of the story with 95 percent accuracy 
I n 20 mi nutes » i 



This specific statement can be contrasted with a more casual objective such as, 
"The student will demonstrate thai he understood a short story he has reado" The goal 
in both cases is understanding or comprehension <» However, the behavioral objective 
gets at comprehension by having the student write down information gained from his 
reading. It puts understanding on a measureable basis and, in fact, provides a blueprint 
for the writing of a test itemo 

The test items derived from a behavioral objective provide the basis for a discrepancy 
analysis, that is, a comparison of what one hoped would result from instruction and what 
was actually accomplishedo A behavioral objective then is a means of focusing on 
just what it is one intends to achieve in the process of education o 

Writing a behavioral objective is time-consuming as anyone who has hied his 
hand at it well knowSo A bank of objectives, a centralized resource from which to make 
selections, is a time-saving device a In using a bank, a school district can gain the 
advantages of defining its curriculum in terms of what it wants its students to be able to 
do without having to put effort and money into writing objectives from scratch « Additional 
time and effort can be saved by having^ as a centralized resource^ pools of test items 
motched to objectives and a collection of references to instructional materials also 
matched to objectiveSo Hnally, the time-saving assets of the SPPED banks will be 
enhanced by their availability through a computer o When stored in a :omputer, the 
contents of the banks can be quickly accessed according to the special interests and 
needs of the user. 

The existence of a bank does not impose objectives on a school district any more 
than it would dictate certain types of testing or recommended certain instructional 
materialso The reading bank^ for example, is no^t a program of reading instruction. 



nor does it advocate any particular approach to reading. The users must make all the 
decisions about what to teach, what they will evaluate, and what materials they will 
employ « Furthermore, the user can and should modify the contents of a bank to fit his 
local situation o Thus local banks^ which are the means of organizing objectives, items^ 
and resources for storage and use, will reflect local needs o 

The Development of the SPPED Reading Objectives 

Concern over the extent of failure in reading and with reading instruction, made 
reading a priority subject matter area for a SPPED bank o 

The development of the reading bank began with a survey of existing collections 
of reading objectiveSo Thi*^ review resulted in the definition of a set of standards for 
the bank of reading objectives and the selection of o framework or classification 
structure for reading objectives o 

The standards established for the bank were these: 

K It should be comprehensive, covering a variety of approaches 
to the teaching of reading and as many as possible of the 
behaviors used to define reading in the school settingo 

2p Its component objectives should be behaviorally specific, 
byt should td<e into account the infinite variety of content 
that can be used in reading objectives. 

3o It should be parsimonious both in the wording of the 
objectives and in the avoidance of redundancy or the 
unnecessary repetition of objectives o 

To mee.** these standards, two new types of objectives were created o One, the 
generic obH r ive (GO), states the type of stimulus material to be given and specifies 
the student response. The other^ a criterion objective (CO), sets a standard of perfor- 
mance on a number of related generic objective'so The generic and criterion objectives 



are discussed in detail in chapters 2 and 3o 

The framework selected for the reading bank was an early classification system or 
category structure for SOBE-R, a ^stem for Obiectives-Based Evaluation in Reading 
developed at the Center for the Study of Evaluation, UCLA. ^ SOBE-R met the stand- 
ard for inclusiveneiss and provided some 800 objectives which could be used as a starting 
point for the- writing of SPPED objectives. A second source of objectives that were 

modified to fit the SPPED standards was the Catalogue of Instructional Objectives and 
. . 2 

Prescriptions for High Intensity Learning Systems. 

The SOBE-R and the High Intensity objectives were based on extensive analyses 
of existing reading curriculums and instructional materials^ The nature of these sources 
in one sense defined the term "reading" for the SPPED bank o Whatever other definitions 
it may have, reading in the SPPED bank means those activities which educators, 
curriculum designers, and the authors of instructional materials call "reading" in the 
elementary and secondary school. In other words, the "reading" objectives describe 
"reading" behaviors expected of children in the school context. 

Over 2200 generic objectives were derived from the two sources cited o Careful 
editing and the use of a computer program to eliminate redundancies resulted in a final 

^ A draft of the SOBE-R User's Guide and Objectives was made available to the 
State Education Department in October 1971 by Rodney W. Skager, project director. 
SOBE-R is now known as SOBA-R, a System for Objectives-Based Assessment in Reading. 

2 y^iQ^ Q^^^^ Anne Marie Mueser, (TifltqlgflV? 9^ Instructional Objectives 
and Prescriptions (New York: Random House, 1 971 )o 
3 

SCAN, a System for Coding Analysis developed by S. Alan Cohen and Robert 
P» O'Reilly, can be used to eliminate duplication, to insure the behavioral specificity 
of objectives, and to refine and update the bank. For technical information write the 
Bureau of School and Cultural Research, New York State Education Department. 
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collection of 1829 generic reading objectives. These generic objectives were clustered 
into a collection of 301 criterion objectives which were assigned to levels or stages of 
reading development. 

The two collections, the generic and the criterion objectives, make up the current 
content of the SPPED Reading Bank- A third element, a collection of lists of stimulus 
materials or content elements to be used in generic objectives, will be added shortly. 
The writing of test items and the identification of instructional resources are both projects 
for the future* While the Reading BOIR is thus incomplete, the objectives are an 
immediate resource for use in curriculum development and by their nature provide c 
solid base for both the preparation of evaluation measures and for the assessment, or 
selection, of instructional materials and activitieso 

The SPPED reading objectives are nov/ available in two paper documents: SPPED 
Resource 5000, Generic Objectives for the Bank of Objectives, Items^ and Resources in 
Reading, and SPPED Resource 5001, Criterion Objectives for the Bank of Objectives, 
Items^ on :. Res vurces ?n Reading o Both collections, along with the lists of elements, will 
soon be available by computero While much of the information presented here wiii be 
pertinent io the use of a computerized bank, this manual is written with the currently 
available paper materials in mind. 

Levels in the SPPED Reading Bank 

Mention was made in the preceding section of the assignment of criterion objectives 
to levels or stages of read5ng developmento The concept of levels as used in the bank 
is an important one, for not only is it a means of organizing objectives, but it also 
reflects a philosophy about learning to read* 
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That philosophy is that learning to read is an ongoing developmental process through 
which inldividuals may proceed in different ways and at different rates,^ 

The best representation of the process of learning to read would be a series of 
continuums thoi suggest these diversities « in teaching a child to read, the crirical 
matter isjto determine or diagnose his progress in the continuum and then to prescribe 
activities and materials that will bring him to the next level of development* Some 
demarcation of the continuum is needed to indicate progress* 

For the reading bank, six 'evels are suggested and defined in terms of develop- 
mental stages o These are: 

1 . Readiness and Early Learning Stage 

2. Intermediate Learning Stage 

3. Advanced Learning Stage 
4o Early Application Stage 

5o Intermediate Application Stage 
6o Advanced Application Stage 

The three learning stages, levels 1 through 3, are ihose usually covered by the 
elementary school program, ioeo, the first seven years of schooling (K-6)« The three 
application stages, levels 4 through 6, are the equivalent of the secondary school where 
rending is used in the study of increasingly difficult subject mattero 

The corollary to the concept of developmental levels in reading is the notion of 
the level of difficulty of reading materials. The beginning reader is given the simplest 
of reading materials while the most advanced reader, (*ie student who is applying his 
reading skills in academic study, will have more complex or "difficult" material. 
Content or reading materials must be rated in terms of the levekfor which they are 
appropriate o 
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Summary and Recommendations for 
Use of the Manual 

In this chapter, we have introduced the bank of reading objectives and described 
Its development as a part of Project SPPEDo In the course of this presentation, three 
basic concepts of the reading bgnk have been given: the notion of a behavioral objeciive 
v/ith its specification of conditions and standards for a particular student performance, 
the idea of a bank to be used creatively for local development activities and as a means 
of organizing the local curriculum, and the perception of levels as a stratification of 
a developmental reading continuum* With these concepts as a framework, we will now 
turn to a detailed examination of the contents of the reading bank and its useso 

i Having been introduced to the bank, users may wtsh to vary the order in which 

\ 

they read the remaining chapters^ Familiarity with the information on the generic and 
criterion objectives given in chapters 2 and 3 will be needed by everyone. The pro- 
cedures for selecting objectives to develop curriculum and relating objectives to 
instruction presented in chapters 4 and 5 will probably be of greatest interest to 
curriculum coordinators, reading specialists, and teachers of reading « The discussion 
of evaluation in chapter 6 will likely be of most interest to those responsible for the 
design of evaluation, testing, and measuremento 

All six chapters of the manual should be read at some time by all per.spns working 
in or with an objectives-based reading program in order that they may have a sense of 
the interrelatedness of curriculum, instruction^ and evaluationo However, the manual 
is not a document to be read at one sitting and set aside « Rather it should be used as a 
reference and consulted as need arises o The table of contents , which notes the subdivisions 
and topics within each chapter should facilitate the use of the manual in this wayo 



8 



' In using the manual, one should of course, have access to SPPED Resource 5000 , 
the Generic Objectives^ and SPPED Resource 500 U the Criterion Objectives, In 
addition, useirs may want to have availcble some of the SFPED publications and training 
materials listed in Appendix A, Familiarity with these materials, which describe 
Project SPPED and its applications at length, will add to the overall utility of the 
reading objectives » 
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CHAPTER 2 

GENERIC OBJECTIVES 

The bank of reading objectives was planned as a comprehensf ve resource, 
capable of encompassing all different approaches to the teaching of reading. At the 
same time, it was recognized that it would be impossible to include every possible 
objective because of the infinite variety of reading material available. This dilemma 
produced the generic objective or GO. 

The Generic Objective Defined 
The generic objective is a behavioral objective which is both specific and 
general . It is specific in that it describes the type of stimulus to be given, states how 
it will be presented, and limits the student response to a particular behavior^ It is 
general in that it does not cite the specific stimulus material or content to be usedo 
The following is an example of a generic objective: 

Example I: Ge neric Objective 

Given oruliy a plural word, the student writes its 
singular formc 

If 

i 

In example I, the type of stimulus is stated (a plural word), and the student 
response is specified (the student writes its singular form)o However, no specific word 
is cited; any plural word could be used. 

The structure of the generic objective, its style, and certain conventions used 
rn writing GO's will be discussed later in this chapter^ First, the ;relationship between 
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generic objectives and instructional objectives will be explained. 



Generic Objectives (GO's)ond 
instructional Objectives (lO's) 



A generic objective to which specific content materials or elements have been 
added is an instructional objective (iO). A generic objective is then a skeleton of an 
Instructional objective. Example 2, below, is a generic objective; example 3, below, 
IS an instructional objective, derived from the generic objective. 



Example 2: Generk Objective 

Given orally two words, the student says if the final 
consonant sounds are the same or different. 



Example 3: Instructional Objective 

Given orally the word*; fat and sit, the student says if 
the final consonant sounds are the same or different. 



The content elements that can be added to the generic objectives Include 
specific letters, words, phrases, sentences, paragraphs, pictures, or selections. By 
varying the difficulty of the content element, a single generic objective can become 
an instructional objective at a number of levels. Consider example 4, below. 



Example 4: Generic Objective 

Grven a selection and given a question about a detail 
in the selection, the student designates the answer.. 
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Example 4 is a generic objective which can be transformed into a specific 
instructional objective at any level by the addition of material (selections and 
questions) of appropriate difficulty. For a beginning reader, the selection might be 
taken from a primer; for a high school senior, the selection might be taken from' a book 
by Herman Hesse* While some generic objectives such as example 4 could be made 
appropriate for any level of reading development, other objectives, such as example 2 
which dealt with letter sounds, might be appropriate only for beginning readers. 

The number of Instructional objectives to be generated from a generic 
objective may be limited by the type of material specified. Where the stimulus is a 
letter of the alphabet, there are only 26 possible elements. With other types of 
material such as passages of fiction or sentences, the possibilities are almost infinite. 
It would not be necessary^ of course, to write out every objective derived from a 
generic objective. Once one had determined the level or levels of the curriculum at 
which the objective was pertinent, one could simply draw up lists of content elements 
of appropriate difficulty and attach them or cross-reference them to the generic form of 
the objective. 

The reading bank is to provide lists of elements from which a curriculum 
designer may choose specific content to add to generic objectives to transform them into 
instructional Cv. ; ctives. These lists of elements will be available in the near future as 
SPPED Resource 5002 . The lists will be arranged by topics such as "final consonants" 
or "compound words. " For each topic, there will be different types of lists — lists of 
words, sentences, selections, pictures, or whatever content would be required by the 
objectives^ The lists will be cross-referenced to the generic objectives, and the 
elements will be arranged by difficulty as indicated by ihe developmental levels 
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described in chapter 1 o 



Table 2c1 shows the topics for which content lists will be availableo 

Table 2 J 

Topics Covered by 
Lists of Elements for 
Generic Objectives 



Adjectives 


Initial Consonants 


Antonyms 


Logical Relationships 


Classification 


/vAain Ideas 


Compound Grammatical 


AAedial Consonant Digraphs 


Elements 


Medial Consonants 


Compound Words 


Opinion 


Consonants 


Possessives 


Contractions 


Prefixes 


Diction 


Prepositions 


Emotions 


Propaganda and Persuasion 


Etymology 


Rhyming Vv^ords 


Fables and Morals 


Roots 


Fact and Fantasy 


Sequence 


FiguTjtive Language 


Singular and Plural 


Rnal Consonant 


Skimming and Outlining 


Digraphs 


Suffixes 


Final Consonants 


Syllables 


Heteronyms 


Synonyms 


Homonyms 


Symbols and Objects 


Initial Consonant 


Verbs 


Digraphs 


Vowels 



The lists for the topics in table 2^1 will provide material for over 50 percent of 
the generic objectiveso In some instances, a list may cover all possible elements for 
an objective o More often, a list will exemplify the elements needed and serve as the 
basic input for a more extensive list to be developed locally to reflect the local context, 
student needs, student interests, and so forth « 
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Structure and Components of the Generic Objective 

The generic objectives adhere to a standard form or structure with two distinct 
parts: the stimulus or input and the student response or outputs Each part has a number 
of components shown in figure 2^1 which follows. The numbered components of the 
generic objective are briefly defined below. They are discussed in greater detail in 
conjunction with the style and conventions of the generic object! veSo 

Figure 2.1 
The Structure a Generic Objective 



^ Given orally a s ubordina te clause, y 
INPUT 

(5) (|) (p 

^ the student says a sentence which contains it.^ 

OUTPUT 



The Input is the stimulus to which the student is to responds It prescribes: 

1 « The mode or manner in which the stimulus is to be presented 
(here, orally)o 

2. The number of stimuli to be presented (here, one)o 

3. A modifier (or modifiers) indicating the special qualities of 
the stimulus (here, subordinate)o 



4o The stir.>>ulus material or content element (here, a clause). 
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The Output is the student response. It prescribes: 



5. The indicator or observable behavior to be performed by 
the student (here, the action verb^ says). 

6c The product or the object of the student response (here, 
a sentence)* 

7o A modifier describing or limiting the product expected of the 
student (here, *'which contains it," limiting the acceptable 
response to a sentence including the subordinate clause 
given in the stimulus)* 

Style and Conventions in the Generic Objectives 

Beside having a single, consistent structure, the generic objectives are written in 
a style that is as brief and concise as possible. Certain conventions have been established 
and a restricted vocabulary has been used with some words carrying special or technical 
meanings* The conventions and the special vocabulary are noted and exemplified here 
in connection with the various components of the generic objectives© 

Mode 

There are four possible modes for presentation of the stimulus material in the 

generic objectives, plus their various combinationSo The four modes are: 

I o Visual 
2. Oral/Aural 
3 0 Kinesthetic 
4o From Memory 

By convention, it is understood that any verbal stimulus, (letter, word, sentence, 
etCo) is to be presented visually — in print — unless otherwise stated© In example 5, 
below, the visual mode is assumed, and the given word would be printed* 
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Example 5: Visual Mode Assumed 

Given a new word, the student says it. 



If a verbal stimulus were to be presented orally, the mode would be noted as in 
example 6. 



Example 6: Oral/Aural Mode Stal ed 

Given orally a word, the student says the number of 
syllcbleSp 



Example 7 shows the treatment of the mode wfien a verbal stimulus is to be spoken and shown 
simultaneously o Here, both the oral/aural and visual modes are statedo 



Example 7: Oral/Aural and Visual .*Vbdes Stated 

Given orally and visually o word, the student designates 
its initial consonanto 



The oral/aural mode is unstated when it is prescribed by the stimulus material . In 
example 8 beloW/ the stimulus— two sounds — can only be presented aurally, so the mode 
is implied. 



Example 8; Qrai/Aural Mode Implied 

Given two sounds of different volume, the student says 
which is softer o 
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Other nonverbal stimuli such as pictures, objects, and books prescriba or imply 
their .".vvde of presentation ♦ In example 9, a picture implies a visual presentation so 
that th4i ,mode is unstated «> 

Example 9: Nonverba l Stimulus — Mode Implied 

Given a picture, the student says whether it depicts 
fact or fantasy o 

Examples 5 through 9 lead to the general principle that the mode of presentation 
is implied by the stimulus; verbal stimuli are assumed to be visual, in print, unless the 
oral/aural rr.ode is stated • 

The fourth mode, "from memory, " means that the stimulus is not present; the 
stimul'^s material vy^as given some time in the past, and the student has to recall ito 
The introductory words "Given instructions to do so" in a GO usually indicate the 
"from mv^mory" mode, as in example 10 below o 

Example 10: Memory Mode 

Given instructions to do -o, the student says the 
alphabeto 



Number 

The number cited in the input of a genenc objective sets the minimum number of 
stimuli required for the student response. In many cases, only a single stimulus is 
necessary, and ^he article a or^ir^ is used rather than the number oneo In other 
cases, multiple stimuli would be neededc Consider example IK 



17 



Example 11: Minimum Number of Stimuli 

Given orally three or more words, the student says 
those containing the same medial consonant digraph 
sound e 

Here, at least three words must be given if a child is to differentiate words that 
sound alike from other words; more words could be used. Where there are multiple 
stimuli, the number given could affect the difficulty of the objective. Specifying the 
exact number to be used or raising the minimum number is one aspect of transposing a 
generic objective into an instructional objective. 

Modifier of Stimulus 

Most of the modifiers used to describe the stimulus indicate special qualities 
inherent in the element or content presented <> Words like "subordinate" as in "subordinate 
clause" and "incomplete" as in "incomplete sentence" are of this typeo 

There are some modifiers which are temporal; that is, they indicate a time 
relationship between the stimulus and instruction o Consider example 12, 

Example 12: Te mporal Modifier 

Given a familiar word, 'the student writes a sentence 
using ite 

The term familiar is used here arid throughout the bank to indicate that the stimulus 
element or content has been previously presented in the instructional sequence. The 
contrasting term, used in example 13, is new. 
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Example 13: Temporal Modifier 



Given a new word, the student locates the word in 
a dictionary and pronounces ito 

New content/ here a new word, is material that has not been presented previously in 
instruction. 

Stimulus Material 

The stimulus material is ihe content or thing presente^ to the students In the 
reading objectives, the stimulus may be a letter, a word, a selection, a picture, an 
object, and so on^ Usually the stimulus has special qualities^ For example, it may be 
a word with a silent letter or a story with a moral o In the interests of brevity, many of 
the generic objectives have been written so that the special qualities of the stimulus 
must be inferred from the expected student response or outpuio In example 14, the 
stimulus word has to be one with a prefix, or the student could not write its prefix^ 

Example 14; Stimulus Qualities Inferred 

Given a word, tlie student writes its prefix « 

: I 

In example 15, the stimulus word has to be one that ends with a consonant; it 
could not be a word like area which ends with a vowel , 

Example 15: Stimulus Qualities Inferred 

Given orally a word, the student says another word 
with the same final consonant sound o 
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Indicator • 

The indicator is the action verb in the GO; it tells what observable behavior is 
to be performed by the student The most frequent indicators In the reading objectives 
are sgy^ write or write about , and designate . 

Designate means "to circle, underline, cross out, or mark one or more of n 
finite number of choices, leaving a physical record of the choice o" A "designate" 
indicator implies'a condition with a limited number of possible answerSo The stimulus 
for a designate response might be a multipie-choice or true/false item, or it might be a 
sentence or prjragraph on which certain types of words or ideas were to be marked o 

In some instances, such as Sample 16, there is more ihan one verb in the output. 

Example 16: Multiple Vera in Output 

Given orally a word, the student substitutes a finul 
consonant a:?d says the word formed. 

Substituting a final consonant in a word is an action performed by the student to 
fulfill the ob(ec^ive, but his sayi ng the word formed is the observable behavior by which 
he may be judged. 

Product 

The product is the object of the indicator or student behavioro It is what the 
student says, writes, or designates. In example 1^ the product is the paraphrase written 
by the student. 
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Example 17; Producf 

Given a selection, the student writes a paraphrase of 
the selection. 



AAodifier of Product 

The modifier in the response portion of a generic objective usually describes or 
limits the product expected of the studento In example 18 below, the modifier "with 
the same medial consonant digraph" describes the word to be marked or designated by 
the students 



Example 18: Product Modifier 

Given orally a word, the student designates another 
word with the same media! consonant digraph o 

As previously noted, the output modifier frequently defines the qualities of the 
stimulus material o In example 18, the given word would be one with a medial consonant 
digraph p 

The Thesaurus 

Some of the words used in the generic objectives with special or technical 
meanings have been defined in the preceding paragraphso Those definitions and others 
are given in the Thesaurus found in ^pendix B of this manual . Users wUI want to consult 
the Thesaurus to be sure their interpretations ore those intendeds Terms not found in the 
Thesaurus carry their common dictionary meaningSo 
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Classification and Coding of Generic Objectives 

The classification system for the generic objectives is made up of six major skill 
categories., These categories and the code numbers which identify them are shown 
below in table 2^2, 

Table 2o2 

Major Skill Categories 
and Codes 





Category 


Code 


1 


Multisensory Readiness Skills 


001 


1 1 


Decoding Skills 


002 


1 1 1 


Vocabulary Skills 


003 


IV 


Comprehension Skills 


004 


V 


Location and Study Skills 


005 


VI 


Reading in Content Area Skills 


006 



Each of these major skill categories has subcategories at one, two, or three levels. The 
subcategories at each succeeding level identify more specific skills or skill areas within 
the major skill categorieso 

The Skill Category Structure is given in its entirety in Appendix C, The layout 
of the structure follows the pattern of a standard outline with Roman numerals (1/11/ 
etco) indicating the major categories, capital letters (A, B, etc.) the first level sub- 
categories, and Arabic numbers (1,2, etcj the second level subcategories. Third-level 
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subcategories are not marked, and, where there is no third-iavel subcategory, the 
second^evel subcategories are not numberedo A portion of the structure, which covers 
Skill Categories 1 I \ and IV, appears in figure 2o2 on page 24, It demonstrates the 
variation in levels within the major categories and the coding system for the subcategories. 

As shown in figure 2o;^ Category III, Vocabulary Skills, is divided into seven 
subcategories, A through G. The code number for each of these first-level subcategories 
has six digits. The first three digits (003) indicate the major skill category; the second 
three (001,002, 003, and so forth) identify the individual subcategories. Code number 

003 003, for example, indicates a Vocabulary Skill dealing with '"Words and Context," 

Category IV, Comprehension Skills, also shown in figure 2.2, is divided into 
three level-1 subcategories with 6^digit code numbers o 

Ao Literal Comprehension 004 001 
Bo Interpretation 004 002 

Co Attitude Towards Reading 004 003 

The three level-1 subcategories are each divided into a number of second-level sub- 
categories^ Subcategory B (004 002), for example, has lO ievel-2 subcategories; their 
code numbers, following the pattern already established, run from 004 002 001 through 

004 002 010. Code number 004 002 008 stands for a Comprehension Skill involving 
"Interpretation" through rhe "Evaluation of ideas and informationo " 

Bv'Jcause there is variation in the number of subcategory levels within the major 
skill categories, the term "lowest level sul)category" will be used in this manual tc> 
indicate an end point in the classification structure. Accordingly, "Words and Context" 
in Vocabulary Skills and "Evaluate ideas and information" in Comprehension Skills would 
be designated "lowest level subcategories «" The generic objectives are subsumed under 
these lowest level subcategories. 
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Figure 2.2 



A Portion of the Skill Category 
Structure for Generic Objectives 



III. VOCABULARY SKILLS 


003 






A* 


Incorporate listening and speaking 










skills into reading vocabulary 


003 


001 




B, 


Recognize and use synonyms, homonyms, 










antonyms, and heteronyms 


003 


002 




C. 


Words and context 


003 


003 




D. 


Recognize historical origins 


003 


004 




E. 


Recognize and use non-literal language 


003 


005 




F. 


Recognize denotation, connotation. 










and nuance 


003 


006 




G. 


Use a systematic, continuing method 










of word study to increase vocab- 










ulary 


UU J 


007* 


IV. COMPREHENSION SKILLS 


004 






A, 


Literal Comprehension 


' 004 


UU± 






Identify main ideas and major concepts 


004 


001 


001 




Find and relate details 


004 


001 


002 




Recognize sequence of ideas 


004 


UU i 


UU J 


B. 


Interpretation 


004 


002 






Understand relationships 


004 


002 


001 




Recognize cause and effect 


004 


002 


002 




Make inferences 


004 


002 


003 




Interpret figurative and descriptive 










language 


\J\J'-r 


002 


004 




Recognize p.nd interpret emotional 










reactions 


004 


002 


005 




Identify and arrive at conclusions and 










generalizations 


004 


002 


006 




Compare and contrast information and 










ideas 


004 


002 


007 




Evaluate ideas and information 


00^^ 


002 


008 




Develop critical reading skills 


004 




C09 




Develop oral reading skills 


004 


002 


010 


C. 


Attitude Toward Reading 


004 


003 






Take proper care of reading materials 


004 


003 


001^ 




Read for enjoyment 


004 


003 


002 




Appreciate reading 


004 


003 


003* 




Relate personally to reading 


004 


003 


004 




*There are no Generic Objectives in thifj 


category. 
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The numbering of the generic objectives continues the pattern of the classification 
structure o Each generic objective carries the code number of the major skill category 
and the subcategories to which it belongs plus another 3-digit number that identifies 
it as a unique objective in its subclasSo For example, the generic objective which reads, 

"Given a fantasy, the student designates the events that could not happen in real life," 
is numbered 004 002 008 002o This number indicates that the GO is a Comprehension 
Skills behavior (004), involving "Interpretation" (002) and, more specifically, calling 
upon the student to "Evaluate ideas and information" (008); it also indicates that the GO 
is uniquely identified os number two in its subclass* The unique number c J the GO is an 
arbitrary number, used simply to distinguish one objective from another in the same 
subcategory c 

The relation of a generic objective to a major skill category is diagrammed in 
figure 2.3 which also shows the development of the code number for the GOo 

Figure 2.3 

A Generic Objective and 
the Skill Category Structure 



Major 

Category Comprehension 



004 



T'^t Level 




Subcategory Interpretation 


004 002 



T V 



Lowest 
Level 

Subcategory 



T 



Generic 
Objective 



Evaluate 
ideas and 
information 



004 002 008 



Given a fantas)^ the 
student designates the 
event that could not 
happen in real life. 



004 002 008 002 
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Presentation of the GO's in SPPED Resource 
5000/ Generic Objectives for the Bank of 
Objectives^ I terns ^ and Reso>jrces in Reading 

The generic objectives portion of the reading bank is contained in SPPED Resource 
5000c. The !829 GO*s are presented there, four to a page, in a format designed to 
provide mnximum information in a minimum amount of space^ Room is provided for users 
to moke notes as needed o Furthermore, the publication is printed on one side of the 
page and has been left unbound for ease in handling and duplication o Thus the objectives 
may be reproduced, rearranged, modified, added to, cut and pasted on cards, organized 
in file folders or ring binders, compiled in booklets, or manipulated in any oiher way 
that meets i ndividual needso 

The objectives art vranged sequentially by code number o They are grouped so 
that' the first-level subcategories in each major skill category start on a now page^ 
Within subcategories there are gaps in number sequences because some objectives were 
eliminated in editingo In subcategory 002 004 006, for example, the unique numbers 
run 046, 047, 049, and 053o The first GO in the entire collection is numbered 
001 001 001 001 003 o Objectives are repeated when they are associated with more 
than one criterion object! veo 

The format of a generic objective is shown in figure 2o4. The contents of the 
format have been identifiec^ and are defined belowo This material warrants careful study, 
for familiarity with the GO format will facilitate utilf'iation of the objectives^ 
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5. 

Levels 



3o 
CO 
Descripfor 



Figure 2.4 

Format for a Generic Objective 
1. 

GO- 
Statement 



4. 
CO 
Number 



ra| Series Repetition! Phrases 



008 



2, 

Category 
Number 



r 



001 



001 002 



001 



Given orally two or more phrases, the student repeats the phrase in the 
order of occurrence. 



005 



158 D: CO 



t t 

Entry Duplicai'e 
Number Indicator 

1 • GO Statement: This is the generic objective. It specifies the type of material 
to be presented as a svimulus (input) and the expected student behavior (output)o 

2o Category Number: This 15'digit code number is the chief means of identifying 
the generic objective. It shows the major skill category and tho subcategories to which 
the objective belongso The final digit, exclusive of zero placeholders, identifies the 
objective ar> a unique entry within its class. The category number in the sample format 
may be interpreted as follows: 
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001 


001 


002 


001 


005 



Unique Number 
Listen for a Series (LeveKJ subcategory) 
Expand Auditory Memory (Level-2 subcategory) 
Auditory Skills (Level-l subcategory) 
Multisensory Readiness Skills (Major category) 

Where there are two subcategory levels within a major skill category, the unique 
number will come in the fourth position and will be followed by zero placeholders. 
For example: 



004 1 002 


OOS 


003 


000 



Zero placeholders 
Unique Number 
Evaluate ide s and information (Leve|-2 subcategory) 
nterpretation (Level-1 subcategory) 
Comprehension (Major category) 

With only one subcategory level, the unique number would occur In the third position, 

and there would be two sets of zero placeholders at the endo 

The category number may be abbreviated by dropping all zeros « Number 

001 002 002 001 007 would then be referred to as 1-2*2-1-7 and number 004 002 008 003 

as 4-2-8-3 . 

3o C O Descriptor ; The CO Descriptor is a brief phrase indicating the content 
of the criterion objective with which the GO is associatedo Criterion Objectives (CO's) 
are fully explained in chapter 3 of this Training Manual o 

4o CO Number ; This is the three-digit number of the criterion objective with 
which the generic objective is associatedo 
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5. Levels: The asterisks indicate the developmental levels at which the GO might 
be appropriate « (See chapter 1 for discussion r>f levels.) 

6c Duplicate Indicator : This item appears only on those GO*s that are associated 
with more than one COc D shows that the GO appears more than once. The number 
given is that oF the other criterion objective with which if is associated. A GO 
associated with three or more CO's would show two or more CO numbers hereo 

7o Entry Number : The entry number is an alternate way of identifying o 
unique objective. The entry numbers run consecutively from 1 to i829 and show the 
order in which the objectives appear in the reading bank; they have no other signifi-- 
cance . 

While the category number of an objective might change as a result of local 
adoption of a different classification system or the assignment of the objective to a 
different category in the existing system, the entry number is a constant. It may be used 
so that there can be followup on an objective regardless of how it is classified or 
modified o 

Summary 

This chapter has described the generic objectives and their presentation in 
SPPED Resource 5000 o The GO's are the basic units in the reading bank. They are 
complemented by the criterion objectives, the second portion of the bank to be 
described in chapter 3c 
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CHAPTERS 
CRITERION OBJECTIVES 

Generic objectives and the innumerable instructional objectives that can be 
derived from them, do not specify the proficfency to be attained by the pupil . The 
criteriofi objective (CO) was created to fill this void and to aid in organizing GO's. 

The criterion objective is defined as an objective which sets a standard of 
performance on a group of related generic objectiveso It may be variously conceptual-- 
ized as a course objective, a major objective for a particular level in the reading 
program, or as a unit objective A criterion objective would be achieved after some 
period of time during which the pupil would have received instruction pertinent to the 
related generic objectives. 

To prepare the criterion objectives for the SPPED bank, the generic objectives 
were systematically examined and clustered together on the basis of common content, 
common student responses, or association in a learning sequence. Association in a 
learning sequence means that the objectives could be regarded as a series of steps : 
leading to the most difficult of the behaviors in the cluster. 

Each cluster of GO's v/as then Identified by a criterion descriptor, a succinct 
label such as "Following Directions" that pinpointed the content, response, or end 
behavior. The clustering activity resulted in a list of 301 criterion descriptors covering 
all of the 1,829 generic objectives. Some CO*s had only a single generic objective, 
while others had as many as 20 or 25. Most frequently, CO clusters had 3 to 10 
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associated generic objectives. Some of the GO's were included in more thon one CO 
cluster . 

The outcomes of the clustering and labeling activity are typified by figure 3.1 
which presents a CO and its cluster of related GO's. 

Figure 3o 1 

A Criterion Objective Descriptor 
with Its Cluster of Generic Objectives 



CO go's 



1 


— Given a selection, the 


student writes a summary of itoj 


Summaries 




— Given 6 selection, the 


student says a summary of it. 








Given c selection, the 


student designates a summary of It. I 



The criterion descriptors are an alternate means of classifying objectives. As 
classifiers, the criterion descriptors are similar to the subcategory labels of the generic 
objective category structure. However, the ystems are not completely parallel . In 
some cases, a CO descriptor covers all of the GO's in a subcategory and may even have 
the same wording. For example, the CO cluster called "Newspapers" contains all 8 
objectives in skill category 5-3-3 which is "Newspapers." !n other cases, a criterion 
descriptor represents a subdivision of a skill category. Thus the 18 generic objectives 
in the skill category "Distinguish Among Sound Characteristics" (1-1-1-4) are divided 
am67';g ?hree CO clusters--"Sounds: Intensity'*; ' "ounds: Pitch"; "Sounds: Duration . " 
In stfli other cases, the CO cluster brings generic object! v.-^^s together by cutting across 
the subcategorfes and even the major categories of the skill strb':ture. The criterion 
objective with the descriptor "Directions: Oral" draws objectives from a "Mul tisensory 
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Readiness" subcategory, "Recall and Follow DirecHons" (1-1-2-2), and from a "Locatfon 
and Study Skills'' subcategory, "Follow Directions" (5-4-1). 

Two types of criterion objectives were written for the criterion clusters: a sampling 
objective and a summotive objective. The sampling type was used for 259 of the CO 
descriptors; summative objectives were prepared for the 42 other CO'so 

The Sampling CO 

A sampling CO sets the standard of performance on a cluster of generic objectives 
at a given level by specifying the number of mputs or items on which the student is to 
be rested, the prooortion of correct responses required, and the time allowed for the 
responses. The framework or skeleton statement for ail sampling CO's is shown in 
figure 3.2, 

figure 3.2 

Skeleton Statement for a Sampling Criterion Objective 

Given samples of inputs from ( Criterion Descripto r)/ 

the student shows mastery at level by generating at 

least % correct outputs in seconds. 

The 5A..»npling CO gets ' ts name from the fact that mastery is determined by per- 
formance on a sample of teut Items specifically written for instructional objectives 
derived from the associated generic objectives. How large a sample of test ftems, what 
proportton must be answered correctly, and within what time p'^riod are all malters to 
be determined by the user of the objectives. Users must also decide which of the 
objectives in a CO cluster will be included In their curriculum and which will be 
evaluated by testing. These latter decisfons are discussed further in the chapters on 
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"Building a Curriculum" and ^'Evaluation. 

The proportion of correct answers required on a sampling CO will vary with the 
type of material or content in the objecfive. A CO dealing with alphabet recitation 
requires 100 percent accuracy. On a CO dealing with main ideas, 75 percent accuracy 
might be acceptable. Curriculum designers may vary the performance standards in accord 
with the capacities or abilities of their students* An advanced or very bright student 
might be expected to work at 95 percent accuracy while a slower student, doing the 
same work, might be required to achieve only 80 percent accuracy a 

The Summotive CO 

The summative CO is a traditional behavioral objective o That is, a summotive 
objective is a precise behavioral statement with a piven (input), a student response 
(output), and a standard of performance o The standard of performance for a particular 
level is determined by the usero The assumption is made that the ability to perform the 
specific behavior of a summative CO indicates that the student has mastered or would 
be able to perform any i nstrurMonal objective derived from each of the generic objectives 
associated with that CO* "Any instructional objective" means, of course, any lO with 
content elements appropriate for the level of reading development at which the student 
is working o The CO for "Manuscript LeMers: Case Correspondence" shown in figure 
3o3 on the following page demonstrates a summatfve objective. 

The child who is able to perform the task in figure 3.3 with a specified number 
of letters, within a specified trme, and at a specified level of proficiency presumably 
would be able to perform instructional objectives derived from th^ generic objectives 
associated in the CO cluster. 
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Figure 3 , 3 
A SummatTve Criterion Objective 



I 

Given, in random order, letters in upper and/or lower 

cose manuscript, the student points to the corresponding 
upper or lower case form of each letter on a manuscript 

alphabet chart, in a total time of seconds with % 

accuracy. 



The associated generic objectives covered by the descriptor "AAonuscnpt Letters: 
Case Correspondence^* are listed below: 

GQ^s for Criterion Objective o n Manuscript 
Letters: Case Correspondence 

Given a manuscript letter, the student points 
to its corresponding upper or lower case form. 

Given a manuscript ietter, the student says 
whether the letter is upper or lower cose. 

Given an upper oj lower case manuscript 
letter, the student points to the letter on a 
manuscript alphabet chart. 

Given an upper case manuscript letter, the 
student points to Us corresponding lower case 
form (in any context). 

Given a lower case manuscript ^etter, the 
student points to its correspondinf;^ upper case 
form (in any context). 

The "Manuscript Letters: Case Correspondence" CO is suggested for the first two 

levels of reading development. It might appear several times in a curriculum with 

different or expanding groups of fetters as content. 

In some summative objectives, reference is made to the stimuli of some or all of 
the associated GO's. For example, the summailve objective for "Outlining" reads: 



34 



Given a lecture, a reading selecon, and/ 
or a topic for a written or oral report, the 
student writes an outiine(s) with major topics 
and subtopics, as appropriate, in a specified 
timeo Teacher criterion. 

The three stimuli of this summatlve objective are mentioned in the first three of 

the generic objectives in the CO cluster given below; the ability to prepare an 

"appropriate" outline to. meet the teacher criterion would involve being able to perform 

the other objectives in the clustero 

go's for Criterion Objective on Outlinf ng 

Given a lectura, the student writes an outline 
from notes taken during the lecture. 

Given a selection, the student writes an out- 
line of It. 

Given o topic, the student writes an outline 
for a written or oral report of it. 

Given a selection and given two or more 
major topics, the student writes two or more 
subtopics for each topic. 

Given a selection and given two or more 
major topics, the student designates two or 
more subtopics for each topic. 

Given instructions to do so, the student writes 
a skeletal outline showing the kinds of letters 
and numbers and Hie way they are used in an 
outline o 

Given instructions to do so, the student writes 
about the uses and values of outlines as study 
aids. 

Given instructions to do so, the student says 
the uses and values of outlines as study aids. 
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Given a selection and given an outline, 
the student designates whether or not the 
outline fits the selection. 

Some summative CO's refer to all of the outputs mentioned in their associated 

GO'so This is demonstrated by the CO on "Verbal Expression: Oral" which reads: 

The studeni shows mastery of Verbal 
Expression by orally telling a familiar 
story, a fantasy, or a personol experience 

in his own words. Time limit: 

seconds. Teacher criterion. 

The three generic objtBctives associoi^ed with this CO are these: 

GO s for Criterion Objectives on Verbal Expression 

Given instructions to do so, the student 
tells a [personal - <perienceo 

Given instructions to do so, the student 
tells a fantasy with himself as the central 
character o 

Given instructions to do so, the student 
says a familiar story in his own words « 

The expression "teacher criterion" is sometimes used in the CO's to indicate those 
instances fn which the teacher must spell out the bases on which she will make her eval- 
uation of pupil performance o While summative CO's are more specific than sampling 
CO's^they do not take away the users' responsibilities for determining standards and 
defining expectations for their students in their local situations^ 

Sampling vs. Summative CO's 

The decision as to whether a sampling objective or a summative objective should 
be used for a cluster of generic objectives was made by the writers of the objectives*, 
These decisions were ba5ied on their perceptions of the fnterrelatedness and interdependence 
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of reading behaviors. Summatlve objectives were not written unless the writers were 
convinced that the ability to perform one behavior was dependent upon, or indicative 
of, the ability to perform all of the associated behaviors. 

Users of the objectives may not agree with the decisions of the writers, in some 
cases they may prefer to substitute a sampling objective for a summative objective. In 
other coses, they may want to modify a given summative objective or to write their own 
summative objective to replace a sampling objective. 

The criterion objectives should be exarr.ined critically and adapted to local 
perceptions and needs . 

Presentation of the CO's in S PPED Resource 
5001 , Criterion Objectives for the Bank of 
Objectives, Items, and Resources In Reading 

The 249 sampling criterion objectives in the SPPED bank follow a standard pattern 
in which the only variant is the criterion descrtp*^or or label for the relxated GO's* In 
order to eliminate undue repetition, SPPED Resource 5001 consolidates the sampling and 
the summative CD's In an extended 35-page chart. This chart lists the 301 descriptors 
for the CO's; gives their identifying numbers; indicates their type or form, i.e., Sampling 
or Summative; indicates the level at which the writers of the objectives deemed them 
appropriate; and shows the generic objectives with which they are associated o A portion 
of the Criterion Objectives: CO-GO Correspondence Chart appears in Figure 3.4 page 
38 . The columns of the chart are identified and described below. 
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Confent of fhe Criterion Objectives: CO-GO Correspondence Charf 

Column 1 CO Number — This is the identification number 
for the Criterion Objective. 

Column 2 Form — An A in this column shows that the objec- 
tive is a sampling objective. B indicates a 
summotive objective. 

Column '6 Criterion Objective Descriptor — This is the label 
which tells the nature of the material and/or 
skill or behavior covered by the associated GO's. 

Column 4 Level of Appearance — Asterisks in the subdivisions 
of this column show at which of the six stages of 
reading development the criterion objectives have 
been judged appropriate by the writers of the 
ob jectfves . 

Column 5 Associated Generic Objectives — The last column 

shows the numbers (skill category number and unique 
number) of all of the generic objectives clustered 
together for a particular criterion objectiveo 

Column 5 requires some additional explanation. To avoid unnecessary repetition, 

the GO numbeis are divided into two parts. The "Skill Category" code portion of the 
GO number appears first; it is followed by Hie unique number which Is given with the 

unique numbers of all the associated GO*s in that category o For example, the chart 
shows that there are two GO's associated with CO 33, "Oral Vocabulcry: New Words." 
Both are in skill category 001 002 001 008. Their unique numbers are 1 and 2. In the 
GC 'ection, the Identification numbers for these objectives would be 001 002 (€1 
008 uOI and 001 002 00 1 008 002. 

The GO numbers are arranged to suggest the relative difficulty of the GO's; the 
most difficult are cited first. In some cases, GO's from different skill categories are 
interspersed in a sequence so that a skill category code appears more than once* 

The CO-s themselves are arranged according tq the lowest skill category number 
of the associated GO^s. CO 33, for instance, refers to GO's in skill category 
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1-2-1-8; CO 34 refers to GO's in l-2-rl-9. Thus the arrongement of the CO list follows 
fairly closely the skill category structure. 

Following the Criterion Objectives Chart in SPPED Resource 5001 is a page of 
formats to be duplicated and used for writing out sampling criterion objectives and 
specifying standards of performance, A blan!< format and a completed format are shown 
in figures 3.5 and 3.6 on page 41 o In this case, most of the information on the 
completed CO was token directly from the Criterion Objectives Chart; performance and 
time standards represent hypothetical decisions by the user. In practice, a completed 
CO would be more the product of local decision making than is this example* 

The corresponding sections of the blank and completed formats in figures 3o5 
and 3o6 have the same numbers and labels* The labels, which indicate the information 
to appear in the various sections, are defined below and referenced to the, columns of 
the Criterion Objectives Chart. 

Sections of Sampling Criterion Objective Format 

1 . Criterion Objective Descriptor — The label for the associated 
go's (Column 3 of CO chart). 

2. CO Number — The identification number of the Criterion 
Objective (Column 1 of CO chart), 

3. CO Statement — In figure 3^ , the skeleton statement for 

the sampling objective. In figure 3.6, the completed 
statement to which has been added a criterion descriptor 
and performance standards (nufr.iber of items, proportion 
correct, and time allowance) for a particular level of 
the curriculum (Column 2 of CO chart shows an A for a 
sampling objective). 

4. Levels-- The level of the local reading curriculum at which 
the criterion objective is considered appropriate (Column 
4 of CO chart). 
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Rgure 3.5 

Blank Format for g Form A, Sampling Criterion Objective 




5c 

go's 
(Open space) 



1. 

Criterion 
Objective 
Descriptor 



CO Statement 



-I 



2. 

CO 

Number 



samples of inputs frorn 

, tlxa student shews mastery at level 

rating at least Z correcr. outputs in 



Figi^re 3.6 

Completed Form A, Sampling Objective Format 



4. 

Levels 



5o 

GO*s 



1. 

Criterion 

Objective 

Descriptor 



CO Sta tement 



2. 

CO 

Number 



Given 2n 



33J 



kamplea of inputs from nnngnnant RnnnH^V Tn^ 1-i 

, the student shows iirastery at level 

^ by generating at least % correct outputs in '^qq 



seconds. (5 /minutes) 



001 002 002 001 3, 12, 1, 5, 7, 9, 10 
001 002 002 004 4 

001 001 001 001 9 

002 002 DOl 18 
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5- go's — In figure 3.5, open space. In figure 3.6 the 

generic objectives that would be used for the formulation 
of instructional objectives at the level specified in the 
CO statement (Column 5 of CO chart—Associated GO's). 

In the last section of SpPED Resource 500 L each of the 42 summative criterion 

objectives is printed out in its entirety In a format simflar to that for the sampling 

objectives^ A summative objective is shown below in figure 3.7, 

Rgure 3.7 

Summative Criterion Objective 
(Form B) 

Verbal Expression: Oral i 034 



The student shows mastery of verbal expression by orally telling a 
familiar story, a fantasy, or a personal experience in h's own words. 
Time limit: seconds. Teacher criterion. 



go's: 001 002 001 009 : 3, 2, 1 



The formats for sampling criterion objectNes and the summative criterion objectives 
are pri ited four tc a page like the generic objectives so that they too may be cut apart, 
pasted on file cards, and manipulated in different ways. SPPED Resource 5001 is also 
unbound so that it may be readily duplicated. Multiple copies or versions of both the 
summative and sampling criterion objectives will probably be wanted by users as the 
CO's will be assigned to different levels In the curriculum and may prescribe different 
standards of performance for different groups of pupMs. 
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The final Item In SPPED Resource 5001 is an alphabetized index of the CO 
descriptors. It may be used as a topical gutde to locate CO's and their associated GO's 
in the Criterion Objectives Chart, 

Summary 

This chapter has completed the introduction of the reading bank by describing the 
criterion objectives and their arrangement in SPPED Resource 5001 , Now that both the 
generic and criterion objectives have been explained, we are ready to consider how they 
may be used in building a curriculum, and their significance for instruction and evaluation. 
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CHAPTER 4 



BUILDING A READING CURRICULUM 

Moving introduced the generic and criterion objectives and the notion of 
developmental levels or stages in reading, we now turn to the task of building a reading 
curr-cu!um. 

Curriculum, as defined for this context, consists of the intended outcomes of 
Instruction. A reading curriculum would be a set of statements describing the behaviors 
students should be able to perform after reading instruction has taken place « These 
behaviors may be shortHrerm objectives dealing with readiness and decoding skills or 
they may be long-term objectives describing lifetime activities such as reading novels 
or getting information from newspapers. Similarly, curriculum objectives may be 
descriptions of minute operations such as designating the final consonant of a word or 
they may be broad goal statements such as, "The student will be able to read so that he 
can acquire and maintain a jobo" 

Building a reading curriculum involves selecting and ordering or sequencing 
objectives. It requires, first, considering the long-term, broad outcomes and then 
identifying the short-term day-to-day and year-to-year instructional objectives that 
will lead to their attainment. The GO*s and CO's included in the bank constitute much 
of the information needed to define the several levels of objectives needed for a reading 
curriculum. 
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To use the objectives for curriculum building one must have a way of screening 
and examining themo Three alternate ways of selecting objectives are presented in this 
chapter: 

1 . The Skill Category method which uses the skill 
structure of the reading bank and the generic 
objectives, 

2. The Criterion Objective niethod which makes 
use of the Criterion Objectives: CO--GO 
Correspondence Chart o 

3. The "Do-I^- Yourself" method. 

All rhroe methods invol e assigning objectives to levels and weighing their 
importance. The three selection procedures are followed by discussions on sequencing 
objectives, translating generic objectives into instructional objectives, and banking 
objectiveso Before these various aspects of curriculum building are considered, some 
overall comments on organizing for curriculum development are in order. 

O^'ganizing for Curriculum Development 

Curriculum development is no easy job. Even with a bank of objectives to draw 
upon, defining a curriculum is an exacting task, requiring the best efforts of a number 
of people. However, the whole idea of a school district or o school deriving its own 
curriculum rests on the premise thut direct involvement, with school personnel selecting 
objectives for the students with whom they are familiar, will contribute to improved 
instruction and better student performance. Such results should be worth the efforts 

Here then are some guidelines for organizing for curriculum development: 

1 . Priority — Let the school district give curriculum 
development priority or do not undertake ito 
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2. Management Responsibility — Assign responsibility 

for management of the curriculum development 
project to one individual who will have status 
and know-how. (Likely candidates for the 
managerial position ore assistant superintendents 
for instruction, curriculum coordinators, reading 
coord! nfators^ and evaluation specialists o ) 

3. Time for Management — Give the project manager 

adequate time to do the job. (AAanaging a curric- 
ulum development project cannot be an after- 
thought in an already crowded schedule.) 

4. Representation — Let the overall planning of the 

curriculum development project be done by a 
committee representative of all persons concerned 
with the reading curriculum. This may mean 
involving members of the community at large as 
well as school personnel. 



5. Teacher Involvement — Be sure that teachers — 

those who will eventually implement the curric- 
ulum — are involved in its development. 

6. Arliculation-- Provide for articulation of the 

curriculum across levels by having represenati ves 
from all levels participate in the development 
process. (Even when a curriculum committee 
is concentrating on one segment or span of an 
instructional program, inputs from other levels 
are essential 0 

7. Committee Size — Keep the size of committees 

reasonable for the job they are to do. A 
policy committee may be larger than a working 
committee o As the work develops, subcom.nittees 
may be forrr.ed for particular tasks. For example, 
a subcommittee might select objectives for a 
particular skill area or level of the reading curric- 
ulum and submit their choices for review by a 
larger group . 

8o Communication-- Maintain communication between 
the curriculum development committee and other 
school personnel and among any suocommittees 
that are formed. 
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9. Commifrfree Time — Provide time for committee 
work either within the school day or in special 
workshops when school is not in session, 
(Summer and vacation workshops are an added 
expense but permit a concentration of effort 
not alv/ays possible when teaching duties conflict.) 

10. O ngoing Activities — Be sure that the curriculum 
project does not die when the committee has 
completed its wcH< . A curriculum is never a 
finished product. AAake provisions for feedback 
from teachers, for evaluation of how adequate 
the curriculum is, and for making changes on the 
basis of experience o 

The exact organizational pattern to be followed in curriculum development will 
vary from district to district. In some locales, curriculum development will be done 
on a districtwide basis, in others it will be done within schools. It would be possible 
for a district to have a set of goals or broad objectives, and then to have individual 
schools draw up their own instructional objectives for attaining those goals. Even 
within schools, there might be alternate sets of objectives reflecting alternative 
approaches to the teaching of reading • Each of these situations would require different 
committee structures o 

Whatever committee structure is decided upon, the most critical considerations 
are invoivement and articulation across levels. The latter is important not only because 
the objectives for one level must be compatible with those at the next level, but because 
the teacher whose class assignment identifies her with a particular grade will probably 
have students at many different stages of reading development. Participating in a 
project that considers the total span of the reading curriculum should help the teacher 
in meeting the varied needs of the pupils in her own class. 

Finally, when a curriculum development project is launched, time should be 
provided at the outset for defining the task. Initial agreement as to the focus of the 
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project—seeing it in relation to the total school currJculum and being oware of the long 
range purposes it will serve — will smooth the way for the work to be done. 

Once a working organization has been j>et up and its purpose defined, the curric- 
ulum developers should establish a procedure for reviewing and selecting objectives, 
franslcting generic objectives into instruct? onal objectives, and for sequencing objectives.. 

Procedures for Selecting Objectives 

As noted earlier, three possible ways of selecting objectives will be described: 
the skill category method, the criterion objective or CO method, and the "do~i t-your- 

self" method. There are undoubtedly other ways of accessing the objectives, and curric- 
ulum planners should first acquaint themselves with the general format of the bank so 
that they can adopt the procedure or the combination of procedures with which they 
will be most comfortable. 

The Skill Category Method 

The Skill Category method for selecting objectives makes use of a chart which 
incorporates skills, levels, and on indicator of the importance of the skill area. The 
skill category structure itself offers a framework for organizing objectives. 

The"Chart for the Selection of Reading Objectives" and the Skill Category 
StructLre appear in SPPE D Resource 5000 with the generic objectives. The Skill Category 
Structure is also found m Appendix C of this ManuaL The Resource 5000 material mcy 
be readily duplicatfid so that all committee members will have copies. 

The steps to be followed in using the skill category method are these: 
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Determine the scope of the curriculum effort; e.g., a full reading program 
for both elementary and secondary school or the minimum essentials for learning 
to read in the elementary school » 

Select Skill Categories 

Review the entire skill structure checking those categories and subcategories 
which are believed to be pertinent- For this first review, keep the broad 
picture in mind; concentrate on what skHls are necessary, not when they will 
be learned. 

If a major category (I) or a first level subcategory (A, B, etc.) is not con- 
sidered important, the review could stop at that point. However, further 
reading of the skill outline may give a better understanding of the category 
contents, or one subcategory might be pulled out and incorporated under another 
topic. The skill categories are not inviolate . They can be shuffled around 
to fit th e perspectives of the curriculum planners. 

Verify Content of Categories 

Having selected skill categories, locate their GO's by category number to 
verify that the content is what was anticipated o 

Eventually, the GO's will be studied in detail; this is a quick spot-check on 
the nature of the objectives. 
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4. Assign Categories to Levels 

Assign skill categories to levels using the Chart for the Selection of Reading 
Objectives from SPPED Resource 5000. 

As shown by the sample section below, the Selection Char!" concentntes on 
the lowest levels of the category structure. The "Skill Category'' column at 
the left of the chart lists the lowest level subcategories in the order they occur 
in the skill structure; their code numbers are given so that they be immediately 
related to the major skill categories and their subdivisions o 

Figure 4 . 1 

Portion of the Chart 
for the Selection of Reading Objectives 
in SPPED Resource 5000 



l-evel of Reading Development 



Skill Category 

5-1-9 Appendix. 
3-1-10 Introduction 
3-l-'ll Overviews. 



Summaries . 



E S N I 

E S N I 

E S N I 

E S N I 
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E S N I 

E S N I 

E S N I 

E S N I 



E S N I 

E S N I 

E S N I 

E S N I 
Jt 



E S N I 

E S N I 

E S N I 

E S N I 



E S N I 

E S N I 

E S N I 

E S N I 



E S N I 

E S N I 

•'j: s N I 

E S N I 



The selection chart includes six columns for the six levels of reading development 
described previously in this manual. These levels mc/ be redefined according to 
local practice, and levels may be added or substracted so that their number 
conforms to the local situation o The letters in each column (E, S, N, \j) are to 
be used by the curriculum committee to indicate whether the ski!i category is 
"Essential," "Supplementary," "Not Appropriate, " or "Irrelevant to Reading" 
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at the level in question* 

Definitions for the ratings are given below. These definitions, like other 

aspects of the reading objectives, may and should be modified so that they are 

of maximum utility to the users, 

E — Essential — a skill which every student 
must ocquire or be oble to demonstra!-e, and 
on which he will be tested. 

S — Supplementary — a skill needed by some 
students to attain an essential skill, or a 
«kill offered as enrichment to pupils who 
have attained essential ski I Is « Testing 
depends on the purpose for which the skill 
is acquired. Identifying a skill as supple- 
mentary o\ a particular level takes into 
account individual differences in experience 
and proficiency brought to the task . 

N — Not Appropr iate at this level — a ski 1 1 
that is relevant to the reading proress, but 
not at the ievei in question . 

I — Irrelevan t to Reading — a skill that may 

have a place in the school curriculum^but 

is not the responsibility cf the reading teacher. 

Attention will probably focus on the "Essential" and "Supplementary" ratmgs, 
but using all four will ensure that a skill category is considered at every level . 
Subcategories which were eliminated in the preliminary review of the classifi- 
cation structure can be crossed out on ine Selection Chart before level assign- 

iner»ts are made. 
Select Generic Objectives 

Using the code numbers for the categories, locate the related generic 

objectives In ^PPED Resource 5000 > Examine each objective In turn and 

determine whether it Is to be included in the curriculum. 
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The criterion for selection should be the contribution the porticular GO can 
make to the child's acquisition of the skill to which it pertains. The judgment 
exercised in the selection of objectives will rest on the pooled experience and 
knowledge of ihe working committee. As GO's are selected, some attention 
should be given to the content that will be added to transform them into instruc- 
tional objectivesc Referring to the content lists for the GO's contained in 
SPPEI) Resource 5002 may also be a helpful step in the v^O selection task . 
The following excerpt from the selection chart demonstrates how it Vi^ould he used 
in the skill category method o Here some subcategories have been crossed out as they 
were considered not pertinent in the preliminary review of the classification structure. 

Figure 4„2 



Portion of Chart for 
Selection of Reading Objectives Used 
Ln Curriculum Building 



S kill Category 



2-2-18 Letter (s) Sound Correspondence 
^ patterns 



2-3-3 Apply phonic generalizations 



Level of Reading Development 




N 



E S N I 



03 N 1 



E S N I 



E S01 



E S N I 

-V/ — 



E S^] 



E S N I 



E S(^I 



E S N I 



Let us suppose the subcotegory under consideration is 2-2-18, "Letter(s)/Sound 
Correspondence." This skill is cerWnJy relevant to reading; but it would be an essential 
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objec^i^'e in only the beginning and possibly the intermediate stages of learning to reado 
AccOidJngi/, in the above figure the E has been circled at levels 1 and 2; the N for 
**not appropriate at this level" has been marked for the remaining stages. 

Now consider some other skill categories that do not appear on the sample. A 
subcategory such as 4-1-2, "Find and Relate Details," is one that would probably be 
marked "Essential" at all levels. On the other h(3nd, a subcategory such as 2-1-5, 
"Cursive Letters:Writing, " might be considered by some teachers as "irrelevant to reading" 
and would be marked I at all levels « 

Difficulties could arise if it were agreed that a particular subcategory^ say 
2-^-4, "Apply Rules of Punctuation and Capitalization^" was relevant to reading but 
there was no level at which it was considered an essential objective. Suppose teachers 
of beginning and intermediate readers did not make a point of teaching punctuaHon and 
capitalization, while teachers of advanced students assumed that it had already been 
learned. Such a situation would necessitate decision making cbout the importance of 
the skill and the lev€;l at which it should be taughto This exentplifies the necessity for 
articulation between levels « 

The CO Method 

The criterion objective me1i^od for selecting objectives makes use of the Criterion 
Objectives: CO-GO Correspondence Chart found in SPPED Resource 5001 . 

As has been noted elsewt'here, the CO descriptors, which are listed in the chart, 
are a kind of classifier. They describe a group or cluster of related GO'so The 
advantage of the CO method is that it incorporates the clustering of objectives within 
levels and the setting of standards for mastery in the selection process. Clustering the 
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go's into mastery groupings would be another step that would have to follow the 
selection of generic objectives by the skill category method. 

The steps to be followed in using the criterion objective chart for selecting object- 
ives would be these: 

I . Set the S cope of the Acti v ity 

Determine the scope of the effort, such as the number of levels to be inc|i;dedo 

2<. Select Criterion Objectives 

Go through the listing of 301 rpiterion descriptors in the Criterion Objective 
Cbc ^ and check fhose believed to be pertinent to the reading program. Look 
up in Resource 5000 the generic objectives cited in the right hand column of 
the CO chart to verify the committee's interpretation of the criterion descriptor. 
Cross our any criterion descriptors that v/ere not checked for inclusion in the 
curriculum. 

3 . Assign Criterion Objectives to Levels 

Review the checked descriptors and decide at which level or levels the 
criterion objectives are to be taughto 

The criterion objectives chart indicates levels for objective*; already*. However, 
these should be regarded as suggestions, **''th the curriculum committee making 
their own judgment cs to levels in their own program. When the committee 
judgment differs from that of the bank writers, the appropriate changes should 
be made in the levels columns on the chart. The levels themselves may be 
expanded in number or reinterpreted In keeping with local practice. 
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In assigning CO's to levels, one may moke a distinction between "Essential" 
and "Supplementory" objectives. Essential objectives are those which ail students 
should acquire and t>n which they will be tested = Sjpplemenfary objectives are 
those that might be »jseful for some students as prerequisites or enrichment , Testing 
depends on the purpose for which they are acquired." 

The following segment of the Criterion Objectives chart shows how it might be 
used by a committee weighing the placem( nt of criterion objectives in the curric- 
ulum. In this case, the committee hasconrerned itself with just the first four 
levels of the development continuum but has subdivided each of these. They have 
eliminated CO 198 and have marked CO*s 199, 200, and 201 as "Essential" at 
different levels. 

Rgure 4^3 

Criterion Objectives: CO-GO Correspondence Chart 
Used for Assigning Criterion Objectives 
to Levels 
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4. Adjust Criterion Objective Clusfers by Levels 

Take each CO selected for tht curriculum and locate by code number in SPPED 
Resource 5000 the associated generic objectives. Examine each GO to dei^srmine 
whether or not it should be included in the curriculurg^xifld, if so, whether it will 
be appropriate for all or some of the levels to which the criterion objective has 
been assigned. Adjust the criterion objective cluster by levels, listing out those 
generic objectives to be included within the criterion objective at each level at 
v/nich it will appear « 

The basis for decision making about the inclusion of individual generic object- 
ives in the CO clusters should be the contribution ihe GO can make to the child's 
attainment of the more general skill suggested by the CO descriptor* The matter 
of the level or levels at which the GO is appropriate depends on the difficulty of 
the task and committee perceptions as to the stage of reading development at which 
it should be mastered. 

The adjustment of the criterion objective clusters by levels is essential for iWO 
reasons. Rrst, the CO's together cover all of the objectives in the bank; an 
individual school district or school will want to exercise some selectivity regarding 
the go's which it incorporates in its curriculum. Second, the individual GO's 
associated w5th a CO may not be appropriate for all levels suggested for that 
particular CO. 

The latter situation, the question of the suitability of all GO's in a CO cluster 
for all levels suggested for that CO, is demonstrated by CO 165, *'Main Ideas." 
The A/tain Idea CO is cited at, and would be appropriate for, all levels of the 
curriculum. However, not all of the eight generic objectives associated with this 
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CO would be suitable for every level. Two of the GO's (4-1-1-12 and 4-1-1-10) 
involve identifying subordinate ideas for main ideas; these would probably be 
suitable for advanced learners, but not beginning readers. Two ether GO's in 
the cluster (4-1-1-46 and 4-1-1-47) call for the student to designate pictures 
illustrating phrases and sentences; these would be tasks for pupils in the readiness 
or early stages of learning to read. Of course, some GO's like 4-1-1-^ which 
simply asks for the designation of the main idea of a selection, would be approp- 
riate for several or all levels of the curriculum. They will become restricted in 
their appiicabili ty only when content is addedo 

5. Setting AAastery Criteria 

Complete the selected criterion objectives by establishing mastery standards 
for each level to which they have been assigned. 

The •^Do^t-Yourself" Method 



In the "do-it-yourself" method, the curriculum committee establishes its own 
framework or outline for the selection of objectives and sets its own categories for judging 
the importance of objectives. Following are a series of procedures or steps incorporating 
these curriculum building tasks: 

1 o Set the Scope of the Activity 

Determine what portion of the reading program the curriculum effort will 
cover . 
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2. Write a Content or Skill Outline 

Tiie curriculum committee might create a new outline or it might make a 

massive adjustment of an existing outline for a reading program. 

Sources to be used in the preparation of this outline might be the skill category 

structure for the SPPED Reading Bank, the content classification system for SCBA^R, 

1 

the UCLA System for Objectives-Based Assessment in Reading/ the Reading section of 
the English Language Arts syllabus published by the State Education Deportment/ 
textbooks on reading, other curriculums, and so forth. 

3. Establish L evels 

Determine the number of levels within the span of the reading program to be 
covered by the curriculum efforto The number of levels may be consistent with 
an existing graded structure or may incorporate a larger number of divisions con^ 
sistent with the structure of continuous progress programs « 

4. Develop a Matrix of Content or Skills a nd Levels 

The matrix of content or skills and levels, combining the products of steps 
2 and 'i above, provides ^he framework for the selection of objectives. 



P. Aschbacher and J. Fitzgerald, SOBA-R Field Manual 1 (Los Angeles: 
Center for the Study of Evaluation, UCLA Graduate School of Education, 1972). 

English Language Arts, Reading Section K-12 (Albany: The State Education 
Department, 1968). 
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5c Establish Categories for Judging the Importance of Objectives 

In developing a curriculum/ judgments must be made about the relative 
importance of objectives at different levelso One scale for rating importance 
might be the following: 

1 . Very important 

2. Above overage importance 

3. Average importance 

4. Less fhan average importarr-e 

5. Inappropriate or irrelevant 

Another way of rating objectives that would reflect their status at different 
levels of the curriculum would be this: 

1 . Essential or basic 

2 o Revi ew 

3 o introduce 
4o Optional 
5. Irrelevant 

The first rating system^ or any variation of i^ might be used for an initial 
screening of objectives; the second for assigning objectives to levels. 

6. Select Generic Objectives 

The categories established in step 5 would be used in selecting the generic 
objectives to fill out the content or skill and level matrix for the reading curric" 
ulum. In selecting GO's from SPPED Resource 5000 / one might use the GO 
classification structure as a means of locating objectives pertinent to the material 
in the locally devised content or skill outline. 

7. Cluster and Label GO's 

Unless the skills in the matrix are to be considered as course or unit objectives 
at the levels to which they have been assigned, the GO's should be clustered into 
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criterion objectives and given a descriptive label . These clusters of GO's v/ould 
be the basis for mastery objectives. 

8. Formulate Mastery Objectives 

Using thejv/o types of criterion objectives in the reading bank as models, 
prepare objectives specifying the criteria or standards of performance for mastery 
ot the clustered GO's at each level - 

Sequencing Objectives 

T'le procedures for selecting objectives have included assi.gning them to levels. 
This means that v/hen selection is completed, one v^ill have established a rough sequence 
of objectives. Hov^ever, it is necessary to refine the sequencing of objectives v^ithin 
levels, arranging them in the order in v^hich they may be taught. 

The ordering of the GO's associated v^ith CO's on the CO^GO correspondence 

chart is intended to reflect difficulty and may help planners sequence GO'so Other 

guidelines for the sequencing of GO's are the various systems for the classification of 

3 

behavioral objectives and the analysis of learning and thinking o Bloom/s Taxonomy 
offers a hierarchial ordering of behaviors in the cognitive domain (knov^ledge, compre- 
hension, application, analysis, synthesis, and evaluation) v^hich can be used to describe 
and order reading objectives^ The five "operations" in Guilford/s '"Structure of Intellect" 



2 B«S. Bloom (ed.) Taxonomy of liducational Objectives, Cognitive Domain (New 
York: McKay, 1956). ^ 

^ J.Po Guilford, *'Three Faces of Intellect," American Psychologist, 1£, 1959, 
469-479. 



60 



and the series of skills ir. Gagne*s Conditions of Learning might also be applied to 
reading objectives . Piaget's developmental stages in children's thinking offer arother 
way of looking at reading tasks and determining their appropriateness in the learning 
sequence.^ An overview of these several ways of looking at skill levels will be found 
in Reading Comprehension as Related to Thinking Processes^ a part of the Reading Resource 
Kit designed to improve teacher oompetency in the teaching of reading produr-^d by the 
Bureau of Reading Education of the State Education Departmento Study of the 
references cited will be desirable as suggested by that publication. In the last analysis, 
;Se curriculum planners must put the generic objectives and the criterion objectives in 
sequence themselves, according to their own understandings of the nature of learning 
and development, and the order in which objectives should occur and their beliets 
about what skills need to be learned first. 

One would anticipate that, regardless of the particular approach to reading 
(look -say, phonic, or linguistic), in some skill areas, there would be a succession of 
objectives which would not be repeated. In decoding, for instance, there would be a 
relatively straight line of progression from recognizing letters to word analysis. Of 
course, some repetition would occur because of different content. Consonants, for 
example, might be introduced one at a time or in clusters, thereby necessitating the 
repetitic.i of some generic objectives with different moterial . But, the acquisition of 

^ RoM. Gagne, The Conditions of Learning (New York: Holt, Rhinehart, and 
Winston, 1965). 

^ J. Piaget, Judgement and Reasoning in the Child (Paterson, New Jersey: 
Littlefield, Adams, 1959) 

^ Reading Comprehension as Related to Thinking Processes (Albany: Bureau of 
Reading Education, The State Education Department, June 1973)^ 
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skill in decoding would reach a frerminal point beyond which further teaching would be 
unwcrrantedc. 

r .... 

In other areas of reading, notably the various comprehension skills., objectives 
would be introduced in beginning reading and would recur throughout the entire reading 
cur'^iculum to the advanced application stage. These objectives would be repeated both 
within levels and at different levels, but^in succeeding stages of reading development, 
the material and thus the task would be more complex. One might describe comprehen- 
sion skills as spiraling upward through the curriculum, increasing their scope as reading 
ability increased. 

The material or content aspects of an objective are on important factor in 
determining its location in a learning sequence. Content is added to the generic 
objectives when they are transformed into instructional objectives as described in the 
next section o The relationship between content and the location of an objective in a 
sequence is somewhat circular^ The initial assignment of a GO to a level of the 
curriculum suggests the iJIfficulty of the content to be added to it. On the other hand, 
the content of the objective may dictate its place in the learning sequenceo Objectives 
concerned with letters, their names, sounds, and j forth, would come early in the 
learning sequence; objectives involving lengthy selections and abstract concepts at a 
later point in time. 

Sequencing objectives will have the effect of stratifying the reading curriculum, 
or of establishing benchmarks within the levels to which objectives were originally 
assigned. While sequencing is necessary, in exactly what order — or if there is any 
order — in which reading skills are learned is a motter of debate. It is known that an 
individual child can operate at a low level on a given skill, say identifying long and 
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short vowels, and at a hfgher level on another skill, like getting the main idea of a 
story. With this in mind, it is best to accept the fact that the sequencing task involves 
a certain degree of arbitrariness. Once teachers begin to use a program and gather 
data on it, one will be able to determine where the selected sequence needs to be 
modified* 

T'*anslating Generic Objectives into Instructional Objectives 

As previously noted, generic objectives become instructional objectives when 
content elements are 'added to themo SPPED Resource 5002 provides lists of content 
elements for some of the generic objectives. These materials lists are suggestions and 
certainly do not exhaust the content that could be drawn upon. The lists are graded 
by difficulty so that the curriculum planner can select materials with level designations 
corresponding to the six developmental stages for the reading curriculum. Content 
selected from other sources must be evaluated as to difficulty • 

How content selection can affect the level of an objective can be demonstrated 
with GO 2-1-3^4:; "Given two or more words, the student designates them in 
alphabetical order." An instructional objective derived from this GO might read, 
"Given four words, the student designates them In alphabetical Oide: a" The difficulty 
of the 10 using list I below would be quite different from that uilng list 2, though both 
contain only four words* 

List 1 List 2 

cat Alaska 

zebra Alabama 

ope Arkansas 

monkey Arizona 
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Adding and Modifying Objectives 

In the process of selecting and sequencing objectives, the curriculum committee 
may find that there are some behaviors which they believe are essential to learning to 
read but which are not included in the bank . When this occurs, the committee should 
write its own objectives or take them from another source » 

The SPPED bank is not a universally relevant, exhaustive, definitive coUe<ition 
of reading objectives. Rather — and this is its value — it is a starting point from which 
a local cyrricutum team can develop its own curriculum in reading. Any CO and GO 
within the collection can be modified to fit local needs and preferences. Deletions 
and additions should be made so that the finished product reflects the best i-hinking and 
efforts df those who will use itc 

When objectives are added or modified, attention should be given to keeping 
them 'consistent with pther objectives drawn directly from the bank. That is, any 
generic objectives should be complete with an input and an output. All components 
of the objective — the mode, number, stimulus, indicator, product, and any modifiers — 
should be clearly stated or indicated in accord with the conventions described in 
chapter 2. Similarly, any new criterion objective should conform to the pat+ernb used 
for other criterion object! ves* 

The curriculum committee may, of course, choose to modify. the style of the 
GO*s and CO^s as they build their own rollection. Regardless of an^ stylistic chonges, 
the final products should be complete and clearly stated o These same standards would 
apply to the instructional objectives derived from the generic objectives* Various 
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materials, such as Norman E. Groniund's Stating Behavioral Objectives for Classroom 

8 : 
lnstruct»iOn offer further guideiint-s for maintaining the quality of objectives. 

The Curriculum Bank 

As soon as the development of the reading curriculuni is unde.way, some system 
for physically organizing objectives will be necessary^ This organization system should 
be one that is amenable to change and that can be expanded over time to include such 
things as test items and information on the utlliza^on of the objectives, test results, 
and instructional materials. A local "banking" operation, containing all of the local 
school or school district materials, would meet these needs. 

As previously indicated, the formots of the Generic and Criterion Objectives in 
SPPED Resources 5000 and 5001 have been designed so that they may be duplicated 
and manipulated in a number of different ways. 

i\ paper bank could be made up of a series of file folders, one for each objective^ 

Test IK rns and other materials could be placed in the file folder with the objective to 

which they were related.' An alternate arrangement would be to put the objectives, 

test items, and related data on color-coded cords, say white cords for objectives, 

canary-yellow for test items, and blue for user information . A third possibility would 

be to hove separate files for objectives, items, and resources with related materials 

carrying the same code numbers. In all three cases, the files could be arranged with 

tab cards showing level and criterion descriptors as shown in figure 4.4. With a file 

system, objectives, test items, and other data can be easily removed anr* sets of objectives 
g 

N. E. Gronlund, Stating Behavioral Objectiv es fo»- Clossroom Instruction 
(Toronto : Ma^millan, lv70)^ 
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Rgure 4.4 



File Arrangement 
for Rending Objectives 
and Related Materials 




and tests readily prepared. More detailed directions for creating a paper bank will be 

found in the SPPED Resource Paper on An Objective and Item Banking System; Paper- 
9 

Based. (See appendix A*} 

Summary 

This chapter has discussed procedures and considerations in the development of a 
reading curriculum from the bank of reading objectives. Once the intended outcomes 
of instruction have been established, the next concern s the means--l-he instructional 
processes — by which those objectives may be attained. Instruction and objectives is 
the subject of the next chapter of this manuoL 



^P.D. Pinsky, M.M.White, andW.P. Gorth, An Objective and Item Banking 
System: Roper-Based (Albany: Bureau of School and Cultural Reseach, The State 
Educotion Department, 1972)a 
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CHAPTERS 

iNSTRUCTION AND OBJECTIVES 

, We have said that the three major components of a school reading program are 
curriculum or objectives, instruction^ and evaluation. In this chapter we will look at 
instruction and how instruction and objectives ore interrelated, 

Instruction is more than what the teacher does in a classroom. It includes every- 
thing designed or selected to help students attain learning objectives--ail planned 
acHvities, presentations, events, teaching methods, teaching materials, and inter- 
actions between teacheis and studerte. The nature of these elements of instructfc»i will 
be determined in large. part by the organizational framework or model in which 
instruction takes place. It is important, therefore, to give some consideration to 
organizational models. 

Organizational Models for Instruction 

Organizational models for instruction are the patterns in which students, teachers, 
teacher aides, and various instructional resources are organized for learning. Some 
models are relatively simple and make use of only a single kind of student-teacher- 
resource Interaction; others ore more elaborate and allow varied and complex inter- 
actiofiS, 

The orgqnizotional model is a key part of instruction. It determines In part the 
kinds of instriJctlonal resources which are suitable for classroom use. In an individualize 
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model where each child has hEs own learning resource through which he proceeds at 
his own rate, there is no need for an overhead projector or other large-group instruct- 
ional devices, but there Is need for a multiplicity of materials for individual use, A 
model which relies entirely on large-group instruction, on the other hand — one which 
is group-paced with a single learning source used simultaneously by all students — 
couldn^t make good use of programmed instruction texts. The overhead projector 
would have a place here. An orgonizational model which accommodates large-group, 
small-group, and individualized Instructional patterns can, of course, take advantage 
of many kinds of Instructional resources. 

The organizational model also determines how much control students have over 
the pace of learning. An individualized model, which Includes several sources of 
instruction available when and for as long as a student needs them^ allows him to learn 
at his own pace. A model whl'ch relies on large-group lectures or demonstrations per- 
formed once and without supplementary instruction, requires all students to move at 
the same pace. 

An objectives-based reading program does not necessitate a particular organiza- 
tional model for instruction. However, the organizational model will determine how 
objectives are used— the number of objeclaves to be attolned, the sequence in which 
they are learned by individual students,^, and when testing occurs for the achievement 
of objectives. 

Organizational Models in Reading 

The organizational models for reading insJ-ruction may be ranged along a con- 
tinuum, with a Whole Class Basal pattern at one end and a Tota.ly Individualized, 
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Diagnostic pattern at the other. In the Whole Class Basal pattern^ there Is a single 
curriculum~a predetermined scope and sequence with one set of materials used simul- , 
taneously by an entire class under the guidance of a single teacher. All students start 
at the beginning of the sequence; after each unit of instruction, they are asserted to 
determine whether or not they have mastered the skills or attitudes taught. Data 
gathered from these tests or observations are used to make adjustments in the program 
and the rate of instruction of the entire class. The entire curriculum is to be complet- 
ed within the school year, and any student not finishing with the group may be required 
to repeat the entire sequence. 

Ah the opposite end of the continuum, the Totally Individualized Diagnostic 
pattern has a broad range of objectives and a wide variety of materials available to 
students in every class. It is assumed that every student has some reading abilities. 
Upon entry into the reading program, each student is pretested to determine which 
objectives he has already mastered and which he has yet to attain. At the same time, 
an effort is made to determine his learning style and other personal characteristics* 
such OS interests which might affect his reading progress. From this information, a 
unique curriculum is formulated for the individual student, and instructional materials 
are selected in keeping with his persona! needs. After each unit of study, the student 
is posttested on the objectives for which he has had instruction, and the results are 
used along with the results of more pretesting to choose the objectives and materials he 
will study next. With thfs totally individualized pattern, the student may work inde- 
pendently or he may be part of a small or large group with similar diagnosed needs. 
The groups are flexible, and the individual proceeds at his own rate. To accommodate 
the various groupings and to assure individual attention, the class teacher or teacher 
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team 's assisted by poroprofessionals, teacher aides, and volunteers. 

The two organizational models {ust described are indeed extremes, and most real 
life classrooms lie somewhere between with elements of both the Whole Class Basal 
model and the Totally Individualized Diagnostic model present in varying degrees. 
The points of contrast, epitomized by the ends of the continuum, are: (1) whole class 
vs. individualized instruction; (2) single vs. multiple curriculums; (3) a basal series 
incorporating one of several possible approaches to reading instruction vs. multiple 
materials with diverse approaches to reading; (4) group-paced vs. self-paced rates of 
learning; (5) posttesting vs. pretesting, postfesting,. and curriculum embedded testing; 
(6) a single teacher vs. multiple staff. How these features are varied and intermingled 
is suggested by the continuum depicted in figure 5. 1 on page 72 , Brief descriptions 
of the eight intermediate models are given below along with capsule summaries of the 
previously described extremes. 

Organizational Models for Reading Instruction 

1. Whole Class Bosal — This large group instruction model uses a single 
set of materials and relJes on formal or informal posttesting re make 
minor adjustments in the rate of instruction for the group. 

2. Self-Contained Classroom, Multiple Groups — With a single group 
and a predetermined sequence, this model assigns pupils to small 
groups on the basis of rate of learning as demonstrated by posttest- 
ing. With several groups and freedom to shift from one group to 
another, con^'iderable individualization can be achieved within 
this model . 

3. Cross Ctoss/Cross Grade Grouping — Still using a single curriculum 
with a predefined sequence, this model forms instructional groups 
across classes and grades on the basis of past achievement and rate 
of learning. Fast groups advance to higher levels of the curriculum 
in these "nongraded" programs which often involve team teaching. 
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4. Muili " Jrg . Mul tir B q&qI — Two or more tracks vvifh different basa! 
series are established by grades fo»jr or five when posltesting on 
past instruction has labeled students as "fast'' or "slow" learners. 
Differences between pupils in different tracks become more pro- 
nounced with the passage of time, 

5. Remedial/Bo fal- — In addition to a single curriculum, slow studenhs 
are offered I'emedial work with special instructional modules and 
materials to help them catch up and maintain their learning rate 
with the rest of the group, Reading specialists, paraprofessionals, 
and volunteers may be used for remedial work within or outside 
the regular classroom. 

6. Multi-Approach Diagnostic — With two or more curricuiuns emphasiz- 
ing different approaches to reading instruction, e.g., phonic, 
linguistic, look-so)', children are pretested formally or informally 

to identify achievement, rate, and learning style and are assigned 
to appropriate curriculums . 

7. Basal With Supplements, Diagnostic — in addition to a basic program 
or basal series, supplementary materials are used to meet individual 
needs as diagnosed by formal or informal testing. This model differs 
from the Remiedial/Bosal Model in that the use of the supplementary 
materials is considered a natural part of reading instruction and not 
a corrective measure for deviations, 

8. Single Curriculum/Individualized Curriculum Diagnostic — The single 
reading curriculum is an elaborated set of skills and attitudes on which 
each pupil is pretested. The student's individual curriculum is made 
up of those skills and attitudes which he has not acquired. In this 
model, there will be as many different curriculums as there are students 
in the classroom. The variations occur more on rate of learning than 
on the objectives. Besides working independently, students may come 
together in small and large groups to work on the same skills or 
attitudes. 

9. Multiple Curriculurm/individual Curriculum Diagnostic — This model 
is similar to the Single Curriculum Diagnostic model except that 
there are mulfiple curriculums (a number of scopes and sequences) 
and a variety of materials. The student's individual curriculum is 
formed on the basis of pretesting which indicates what skills and 
attitudes he has to acquire. 



10. Totally !r>r!;vidua|ized Diagnostic — Here, there are alternate cunic- 
ulums with a broad array of skills and c*^'"**'"r***s and great diversity 
in the available materials* The student's individual curriculum is 
determined by pretesting and an iBffort is made to mcitch materials to 
his personal needs. 
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In addition to describing existing organizational patterns, the foregoing models 
illustrate the historical trend in b^th the practice and theory of reading instruction. 
The current emphasis, incorporated in the Regents 1971 Position Paper on Reading^, ^ Is 
on the individual ized-diagnostic-prescriptive cpproach to reading instruction. This 
approach complemeni:s the view that learning to read is a developmental process 
through which each child progresses at ',is own rate. The crux of reading instruction 
IS to determine the stf^e of development the child hoi reached and then to select the 
particular experiences and materials which will help him to move on to the next 
developmental level. 

Although the trend is toward the diagnostic models, the most common patterns 
for reading instruction are those at the left of the continuum, w'th models 2 through 5, 
or some variation of these, predominating. Many schools are attempting to move 
toward diagnostic patterns, but only a few have achieved a totally individualized 
diagnostic mod . While an objectives-based curriculum can be used in any organiza- 
tional model, behavioral objectives and the test items associated with them can make 
the greatest contribution to the improvement of reading instruction by helping teachers 
provide diagnostic-prescriptive instruction. 

Using the Models Continuum 

In a given school system or a given school, one would undoubtedly find more 
than a single organizational model for reading instruction. In New York City, with its 
thousands of classrooms, one could probably find examples of all possible models on the 
continuum. The school district which undertakes a curriculum development project 
] 

Regents of the University of the State of New York, Reading^ A Statement of 
Policy and Proposed Action (Position Paper No. 12; Albanyl ihe btafe tducation 
Department, July 1971). 
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using the bank of reading objectives will want a clear picture of just how it is currently 
organized for reading instruction. The models continuum is a tool for appraising the 
local school situation. Because there is diversity within a school district, it will be 
necessary to identify the unit which is to be examined. Possible units are schooJ 
buildings, grade levels within buildings, and individual classes. 

The most meaningful analysis would start with individual teachers locating their 
classes on the continuum. (This analytical process must be clearly understood as a 
fact-finding procedure and not a basis for teacner evaluation or it will be both un- 
productive and psychologically damngiri^^*) The results of the class analyses would be 
combined to give a composite picture for a scKcoL The resui would probably be a 
kind of scattergram as shown in figure 5.2, page 76 . In this case, it is apparent that 
organizational patterns change with progre^is through the grades and that there ar3 
individual attempts at diagnostic teaching. Specific steps for use of the continuum 



are these: 



1. 



Review the continuum and the desenprions of the 10 models. 



2. 



Place a mark on the continuum tc irhow where your class (or 
other unit of analysis) stands in rel<5tion to the given ,models. 
Be realistic in your appraisal. Do not conftjse intention — 
how the unit is supposed to function — with what is actual ly 
happening. 



3. 



Draw up a list of the aspects of your class which caused you 
to locate it where you did. . , ^ 



J — - ' 



4. 



Discuss the placement of your class and your list v/ith a 
colleague v/ho is fmmiliqr with the situation, making any 
adjustments resulting from the sharing of perspectives. 



5. 



Select the model that you would consider ideal and mark 
its position on the continuum. 
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6. Compare the actual with the ideal as a guide for determining 
modifications to be made. 

7. List the changes required to achieve the idea!. Thedje might 
include: 

a. Better definition of objectives 

b. Additional teaching resources 

c. Auxiliarvf staff j 

d. The development of both informal and formal testing 
procedures. 

e. Training in organizing curriculums for individual 
i. pupils or groups of pupils within classes. 

'i 

8. Develop a plan to move toward achievement of the ideal. 

a. List the management objectives to be achieved, 
e.g., developing a file of individual learning 
prescriptions. 

b. Define the activities needed to achieve the objectives, 
e.g., to develop a file of learning prescriptions, 
analyze existing learning moierials. 

c. Develop a schedule and budget. 

Having determined the current status ;;f the reading program and established the 
ideal to be achieved, the plonnf ^g committee can begin to concern itself with instruc- 
tional activities and materiaU. The next section of this chapter takes up the matter of 
obtaining needed resources. This may mean finding a ready-made program that meets .lo- 
cal needs, pulling together materials from a number of aourv::^^ or designing new 
resources. 
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Instructional Activities, Materials, and Objectives 

Turning from the organizational aspects of instruction, we will now give brief 
attention to instructional activities and materials in an objectives-based reading 
program. 

If the objectives of the curriculum tell what it Is you want pupils. to be able to 
do, then they are the best guide for the selection and development of instructional 
activities and materials. However, objectives alone cannot determine the means of 
instruction. 

Also to be considered are: 

1 . Student characteristics -"their abilities, their individual 
learning styles and rates, their interests, and fheir 
previous learning experiences both in and out of school . 
A teaching device that is a sure thing with one pupil 
may be a total failure with another, all because of 
individual differences. 

2. The instructional environment — the physical and financial 
resources of the school and the organizational model for 
instruction. This factor puts limits on the particular 
methods and materials that can be used. Self-instructional 
video cassettes, however pertinent to objectives, would 

J 

be of little use without the necessary television equipment; 
they would also be quite inappropriate for large-group 
instruction. 

78 



3. Lea rning pri nci ples rele vanf to ihe type of response to be 
taught or the type of student . For example, the amount 
of practice required for a student at one level of ability 
to learn a given response may be many times over that 
required by a student at another level of ability. Feed- 
back and other reinforcement contingencies affect learn- 
ing. Some students react positively to concrete reinforcers, 
while others react primarily to praise and bhame. Relevant 
learning principles are included in standard texts in educa- 
tional psychology and in specific research reports available 
on certain areas of learning. To apply these principles, ft 
is necessary to identify the type of response required by an 
objective and then to match it with the class of responbos 
cover2d by the learning principle, e.g., auditory discrimina- 
tion learning. This type of analysis will make clear the 
limitations of objectives in serving as a source for the deriva- 
tion of instruction . 

Keeping these considerations In mind, here are some different procedures for 
deriving instruction from objectives. They involve (1) selecting resources, including 
a basal reader, (2) modifying resources, and (3) designing new materials and activities. 
These three procedures may be sequential. That is, if existing resojrces are not suit- 
able for the objectives, *hen one may be obligated to modify them or, as a final resort, 
to come up with his own ways and means of teaching the objectives. Whatever pro- 
cedure is used, here is the same necessity as in the curriculum development task for 
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oi'ganizing personnel, fixing responsJbilitv, and assuring cooperafion and communication. 

Selecting Resources 

In selecting resources, a curriculum committee may be utilizing what they 
already have on hand or they may be making new acquisitions. In either case, similar 
procedures apply. The steps outlined below assume that the committee is working with 
materials on hand. 

1 . Define the area of the curriculum for which resources are to be 
selected^ and list ail the instructional objectives to be covered.. 

The curriculum could be divided up by level, by topics or skills 
within levels, by topics or skills across levels, or by units of . 
instruction. However the limits of the task are set, the focus 
must be on specific instructional objectives or summative criterion 
objectives so that matches may be made in terms of actual content 
and levels of difficulty. 

2. Draw up an inventory of existing instructional resources: basal 
series, supplementary readers, trade books, audiovisual materials, 
and 5^ forth. 

In inventorying materials, separate lists may be prepared for the 
different levels of the reading progrom. These should be considered 
tentative level asslgnmen^s until the materia! has been reviewed 
in relation to the objectives of a given leveL 

3. Review the inventoried resources to locate activities and materials 

related to the specific objectives of the curriculum, 

' . ■ *' ■ 
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a. Use indices, tables of confehts, and teacher editions to 
locate appropriate material. 

b. Skim resources looking for content which matches the 
objectives. 

c. Use published analyses of resources to locate pertinent 
references. 

The skill categories, the CO descriptors^ and the content elements 
would be key words to use in pursuing steps a and c above. The 
reviewet^ should be aware of alternative terms on which to search. 

4. Analyze the materials and activities to determine whether or not 
they match the instructional ob|ective[s] of the curriculum. 

This matching process may require inferring an objective \Totr\ the 
material or activity and then comparing the inferred ofe|jeLCtlve_^ 
with the stated curriculum objective. * 

5. Record with the objective number, the materials reference includ- 
ing the name of the resource and the exact pages or other location, 
e.g., frames 5 and 6 of a film strip, where the material is found. 

6. Have the appropriateness of the selections reviewed by one or 
more other members of the working committee. 

Steps 1 and 3 through 6 above wouldropply in appraising new resources to be 
acquired for an objectives-based reading program. A decision about pi-jrchasing a 
particular material would depend on whether it filled a void in existing resources and 
how useft^l it would be or to how many different objectives it would apply. 

It might be found that a single commercial program such as a basal series embraced 
all of the objectives deemed essential by the. curriculum committee. The adoption of 
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any comprehensive program with the financial investment thar it entails should be based 
on a thorough examination of the material in light of what the school or school system 
has established as its objectives in reading. 

Recordkeeping on prospective purchases should include a listing of all objectives 
to which the resource would apply with a reference tc >he exact location of the 
material for each objective. 

Modifying Resources 

This procedure recognizes that some materials nay be related to objectives but 
may not have the sume intent. Similarly some activities may be relevant to objectives 
in the curriculum, bu*- they may not be appropriate for the students in question, or 
they may not take into account applicable principles of le ^ ing. With some modifica- 
tion, these materials or activities could be used to teach the stated instructional 
objectives. 

1 . In the course of the review of existing resources described under 
"Selecting Resources" above, make note of materials that are 
relevant but not fully compatible with objectives or that need 
change in light of itudent needs or learning principles. 

2. Write up instructions for modifying the resource by, for example, 
expanding the content of the activity, e.g., adding vocabulary, 
or by changing or adding an activity to more effectively apply 
a relevant learning principle, e.g., adding practice exercises. 
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Designing Instructional Materials and Activities 

This procedure calls upon the school staff to exercise their professional experi- 
ence, their understanding of the children they are teachhig, and their knowledge of 



the principles of learning. It may give teachers an opportunity to formalize and shore 




with others activities which they have used successfully in their own classrooms for 
some time, or it may require the invention of new activities or materials. These are 
the type of steps to be followed in designing instructional materials and activities: 

1 . Analyze the instructional objective in terms of content and student 
behavior. List out the input stimuli and the expected student 
responses. 

2. Determine the class or type of learning represented by the objective, 
e.g., discrimination learning. (Recognizing the type of learning 

is important because the ultimate Intent may be to transfer the 
learned response tc! other situations.) 

3. Determine the appropriate mode or modes for presentation of the 
stimulus and for the student response. 

4. Determine the relevant principles of learning in such areas as re- 
inforcement, practice, review, and so forth. 

5. Devise activities that incorporate or lead to the behavior of the 
objective, applying the relevant learning principles. 

6. Write out explicit instructions for the conduct of the activity, ! "~ 
including specifications for: 

a/ the materials to be used 
b. the models] of presentation 
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c. the spacing of reinforcement and the type of reinforcer 
to be used, e.g.^ a concrete reinforcement such as 
candy 

d. the spocing of prac^ice or review. 

7. Hove the activity tried by two or more teachers. 

8. Modify the activity on the basis of classroom experience with it. 

All of the above procedures involve personal judgments about the utility o^- valid- 
ity of Instructional mnterials and activities. These judgments rely on the^^e being an 
obvious match or similarity between the stimulus material and student ^ ehavior specified 
in the objective and the content and activity of the instruction, in the long run, how- 
ever, the validity of instructional activities and materials depends on whether or not 
they do enoble the student to attain the objectives with which they are associated. 
This brings us to evaluation which will be the topic of the next and final chapter of 
this manual- Before moving on to that topic, we will briefly consider the matter of 
incorporating instructional resources in the local reading bank. 

Banking Instructional Resources 

The procedures for selecting, modifying, and designing instructional materials 

and acfivifies have all used objectives as the starting point. Permanent records or 

indices on instructional resources should indicate the objectives for which they are to 

be used and the leva' or stages of reading development for which they are intended. 

Other pertinent information would be: 

1 . The organizational model for which tfie resource would be 
appropriate (large group, small group, or independent study) 

2. Staff requirement's (Is the material self-instructional oi is the 
direction of a teacher or aide required?) 
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3, Special equipment needed 

4. The type of learning Jnvclved 

5, The modes for the stimulus presentation and the stimulus response 

6. Any available data on the type of students with whom the resource 
has proven successful. 

Eventually, it should be possible to add information about the effectiveness of 
the resource with students in the local school situation. 

The references to resources may be maintained in file folders or on cards in a 
manner similcr to that suggested for objectives at ,ne end of chapter 4. These refer- 
ences should be complete with page numbers or other specific information on the loca- 
tion of mciteriul and with the publication or other source clearly identified. An 
additional file system will be required for materials and activities developed by local 
school personnel . This file would probably be composed of master copies of materials, 
such as work sheets and vocabulary lists, and procedures which could be duplicated in 
quantity as needed. The complement of a well developed set of references to 
resources is, of course, a readily accessible collection of the materials, adequate for 
the number of teachers and pupils that will use them. 
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CHAPTER 6 
EVALUATION 

In this chapfer we come to evaluafion--its purpose, design, and the role it can 
play in the reading program* 

The Purpose of Evaluation 

Current theories on evaluatvon in education define its primary purpose in terms 
c" \9cision making. Evaluation is regarded as the process by which one obtains pert- 
inent information or data for specific decision-making activities, in the SPPED project, 
decision-making activities, are related to the effective management of instruction. 
Effective management requires decisions about: 

. students as they are involved in instruction 
, the content and methodology of instruction itself 
. the adequacy of the curriculum. 
Decisions about students will focus on the objectives they study and the instruc- 
tional experiences to which they are exposed. Decisions about insiruction result in 
such actions as replacing or redesigning materials or adding more practice to an instruc- 
tional module. Decisions about curriculum result in actions such as eliminating or add- 
ing an objective, shifting an. objective to a later point in the instructional sequence of 
the reading program, or adjusting the performance standards for a given objective. 
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These examples should suggest that wii-hin a school or school disfricf different 
people will be involved in decision making. Decisions about students and about some 
aspects of instruction — for instance, which of available materials to use — will most 
likely be made by the classroom teacher or by the classroDm teacher and the reading 
specialist. Other decisions about instruction, such as whether a new series of program- 
med materials should be introduced, and those about the adequacy of the curriculum 
will probably be made by a group of teachers or a curriculum committee. Some 
decisions about instruction — for instance, those involving sharp departures from exist- 
ing teaching methods or the expenditure of new funds, as well as some curriculum 
changes — may require administrative and even community participation. 

What is considered pertinent information or data to be provided by evaluation 
will vary with the decision-making task and the persons involved. Determining these 
information needs is the first step in setting up an evaluation design. 

Evaluation Design 

if evaluation is to be used for decision making^ one must have an appropriate 
plan or design. One must first ask: 

. What type of data or information is needed? 
. How much data is needed? 
. When will the information be needed? 
• How often will it be needed? 
The answers tc t'lese questions will vary with the decision to be made. Decision 
making about the daily program of an individual child, for example, would require 
information on his performance on specific instructional objectives; this information 
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would be perf-inent- before as well as during and after the 'nsf-ruct-ion on those objectives. 
Furthermore, the teacher would have to have several examples of a child's performance 
on a particular objective to be sure that he had mastered that task, A kindergartener 
labeling one picture of a carrot "vegetable" would not be evidence that he had learned 
the concept of "vegetable," For some decisions on individuals, the teacher would 
also want information about the student's background, health, interests^ and so forth. 

What information is needed and how often are determined to some extent by the 
instructional model for the reading program. A Totally Individualized Diagnostic 
model demands frequent data collection on every child for decisions are made for each 
individual on an almost daily basis. Conversely, in a Whole Class Basal model with 
group-paced instruction, testing can occur less frequently, and the data for individuals 
can be pooled so that decisions are made on the basis of group performance and the 
needs of the majority. In an intermediate model which combines group and individual- 
ized instruction, the information needs would be somewhere in between. Pooled data 
would be appropriate for determining the progress of the class from one set of objectives 
to another. Individual test results would be necessary to make decisions about instruc- 
tion for those students who did not keep pace with the majority. 

For a teacher to make decisions about the instructional process in the classroom, 
pertinent data would be the proportion of pupils who achieved particular objectives 
when certain materials or a given teaching approach were used. Also Important would 
be information on the characteristics of pupils with whom materials were successfiji. 
Decision making about whether to continue or abandon a particular type of instruction, 
such as the use of programmed materials for reading, could be based on group data on 
selected objectives obtained at longer tirne Intervals, 
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Decisions on the adequacy of the curriculum would also require group data on 
the achievement of objectives . The frequency of data collection would depend on 
whether a segment or an entire curriculum were under study. Lower level objectives 
might be validated by finding out whether students who achieved them were successful 
at subsequent levels of the curriculum. In such ccse^ the results of several years of 
testing might be used. 

When the type, timing, and frequency of the Information needs of decision 
makers have been established, one can proceed to the other major aspect of evaluation 
design: determining the means by which the data will be collected, setting up a 
schedule for the data collection, and deciding upon the ways in which the data will be 
reported. The major means of gathering information for decision making is testing, 
which is the next consideration of this chapter. 

Before concluding this section, one should note that if the procedures for curricu- 
lum development suggested in this manual are followed, the process of evaluation 
design will have been started with the selection and sequencing of generic and criterion 
objectives. The objectives selected wM| prescribe some of the information needi* of the 
decision maker; he will want to know how students perform on those objectives. Test 
design and test scheduling will be based on the specifications given in the criterion 
objectives and on how they are organized intc instructional units or modules. The 
construction of test items will be determined by the GO's associated with the CO's and 
the GO content material . 
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Te^i^ng 

We have said that the major means of data collection for educational decision 
making is testing. While the term "testing" is most often equated with a "written 
examination" or a pencil and paper test, it can encompass many types of data gather- 
ing or observation. Observations can be made on oral or manual performance; they 
may focus on a single performance or look at what a pupil does over a period of time. 
They may be used to assess such diverse things as interpretive oral reading and reading 
appreciation. An observation of interpretive reading might use a checklist covering 
voice pitch, intonation, pronunciation, and sc forth, while an observation for reading 
appreciation might entail counting the number of books a student took out of the library 
in the course of the year. Whatever the observation defined as testing, the important 
thing IS that it be objective and that there be a record of the performance observed. 

Testing in an Objectives-Based Reading Program: 
Criterion vs. Norm-Referenced Testing 

In an objectives-based reading program, the purpose of testing is to dfeTermine 
whether or net students can perform those behaviors which are the intended outcomes 
of instruction* The tests derived from behavioral objectives are referred to as "perform- 
ance" or "criterion-referenced" tests. The laHer term is used because test performance 
is evaluated in terms of the criteria or standards stated in the objectives. Criterion- 
referenced tests are frequently contrasted with norm-referenced or standardized tests. 

Standardized reading tests as they are used in many of toda)/'s reading programs 
are of little use for decision making by either the classroom teacher, the school adminis- 
trator, or anyone interested in knowing the effectiveness of the reading instruction. 
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The inadequacy of standardized test data is due to the coni-enr of the commercially 
available evaluation instruments, the way they are constructed, and the way test results 
are reported. While performance tests measure specific iHrhovioral objectives, standard- 



ized tests usually assess global skills such as comprehension and "word knowledge," 
Standardized tests may indicate general areas of strength or deficiency; they do not 
tell teachers what students need to learn nor do they help curriculum designers decide 
what materials to purchase or what instructional activities to instigate to change 
student behavior. 

In the construction of a norm- referenced or standardized reading test, items 
measuring the general skills of comprehension and word knowledge are administered to 
a representative sample of students at a given grade level. The items selected for in- 
clusion in the finished test are those passed by 25 to 75 percent of the students in the 
sample; the largest number of items in the completed test are those that were passed by 
50 percent of the sample students. This means that test items on v hich all students 
might score well are eliminated at the start. 

As a result of this construction procedure, the test scores of the standardization 
group are distributed in the bell-shaped normal curve shown in Figure 6, 1 , The scores 
of students subsequently taking the test are compared v/ith those of the standardization 
group, and an individual student may then be graded as average, above average, or 
below average. The percentile standings in which standardized test scores are usually 
reported simply compare a student with a group rather than indicating what degree of 
proficiency he has attained. 
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Rgure 6.1 

Normal Curve Distribution of Scores 
on a Standardized Reading Test 
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Again, the comparative data of standardized t'est scores are of very limited 
diagnostic use to the teacher, the school administrator, or the interested outsider. The 
scores do not tell what skills the stucjents have or have not achieved, and they do not 
give any specific clues as to what needs to be done if there is to be improvement. 
Moreover, the comparative score * of standardized testing can create psychological 
and motivational problems which may interfere with the instructional process. Compara- 
tive results can be equally harmful when the teacher uses a normative approach in her 
own teacher-made assessment procedures. The child whose test scores are always below 
overage may lose his incentive for reading. 

As previously indicated, on alternative to norm-referenced testing is criterion- 
referenced testing. The basic differences between these two types of testing are not in 
the kinds of questions asked (they are often the same), but in the procedures for select- 
ing test" items and the method of reporting results. 
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Items on a criterion-referenced test are determined by the objectives they are 
intended to cover. The objectives specify the nature of the test items and the standards 
of performance. Performance standards indicate the proportion of correct responses 
that will be accepted as evidence of mastery. Test results are reported in terms of the 
performance standard or mastery criterion; the mark for an individual student may be a 
simple "pass or fail" — achieved or not achieved. For example, a criterion objective 
on Syllabication (CO 132) might require the student to designate the number of syllables 
In 10 words of 2 to 5 syllables each with 90 percent accuracy. Test results for 10 
students on this objective might appear as in Figure 6.2. 

Figure 6.2 

Test Results for 
CO 132: Syllabication 
Level 1 

Number of Words: 10 
Performance Criterion: 90 Percent Correct Responses 



Student 


A 


B 


C 


D 


E 


F 


6 


H 


1 


J 


Number 
Correct 


9 


■ 9 


10 


8 


10 
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9 


10 
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Pass or 
Fail 


P 


P 


p 


F 


P 


F 


P 


P 


P 


F 



Summary: Students tested - 10; Passing - 7; Percent meeting 
criterion - 70 



Because it is directly related to curriculum objectives and hence to the instruc- 
tional program^ and because its results put attention on achievement in terms of a 
criterion or standard of performance rather than on comparisons among pupils, criterion- 
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referenced testing is considered by many ro be more constructive and humane than 
norm-referenced testing. The testing referred to throughout this discussion is criterion- 
referenced testing. 

Types of Tests 

Tests can be classified in different ways according to their content and the time 
at which they are given. 

A survey test is one that is distinguished by its content; it covers a total course 
or program by including some items on every topic in the course. Year-end or semester 
examinations in academic subjecfs are good examples of survey tests for they usually 
cover most areas of the course but not every detail studied. 

A survey test in an objectives-based reading program could cover all of the 
criterion objectives for a given level . However, unless the total number of CO's was 
limited, an all-inclusive survey test would be unmanageably long. Accordingly, a 
reading survey test might cover only the most important criterion objectives for a given 
level of the curriculum. Developing such a survey test would involve a high degree of 
selectivity as one would have to determine not only the CO's to be tested but also which 
of the go's associated with the CO's should be assessed. Some CO*s at a given level 
may actually be prerequisites for other CO's and could be eliminated from a survey test 
for that reason. 

A survey test might cover objectives at a number of different levels of difficulh/. 
The reading surveys used to place children in a reading curriculum often follow this 
pattern. 

Sometimes the term "survey test" is used to describe the standardized tests used 
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to obtain Information on large numbers of pupils. When used for this purpose^ the 
survey test usually taps general rather than specific skills or objectives. Survey tests 
for groups would be more useful if written on specific behavioral objectives. 

There is no single type of test that can be contrasted with the survey test. The 
general characteristic of these "other" tests is that they are limited in sccpe. A unit 
test, for example, limits its content to a porticular unit of instruction. In an objective: 
based reading curriculum, a uni*- test would likely cover ail of the criterion objectives 
in the unit. 

To classify tests by time, one could use these categories: Pretest, curriculum- 
embedded test, porttest, and retention test. The point of reference in each case is 
instruction. 

A pretest is given before instruction occurs. 

A curriculum-embed ded test (CET) is given in the course of 
instruction and may even be a part of the instruction. 

A posttest is given after instruction, 

A retention test is given sometime after instruction when 
there has been on opportunity for other ledming to occur; 
it follows a posttest so that one can compare what is 
remembered with what was learned. 

A single test can be labeled or classified in different ways. A survey test, for 

example, may be given as a pretest or a posttest. As a posttest, a survey test is in 

many respects a retention rest; thai is, it includes items on objectives learned seme 

time in the past. 

In an objeci ives-ba;,ed reading program, the various types of tests may be used 
individually or in combination. Which ones are^ used and how often will be determined 
by the decisions io be made. The decisions to be made will in turn be influenced by 
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the curriculum, by the way objectives are organized into units or modules, and by the 
instructional model. Diagnostic individualized instruction usually entails more testing 
than does group-paced instruction because diagnostic individualized instruction requires 
more dscision making. 

The kinds of decisions that can be made with test results are demonstrated in the 
following more detailed descriptions of test types. The information given will be 
summarized in table 6. 1 on pages 98 and 99. 

Survey Pretest — This test samples all of the important criterion objectives for a 
year or level. Results of a survey pretest would tell a teacher which groups of objectives 
(units), if any, were already known by some of the children. The pretest would give 
the teacher a general idea as to which areas of the curriculum would need emphasis, 
which units might be eliminated altogether, and how pupils might be grouped for 
instruction. 

Unit Pretest — A unit pretest covering all of the criterion objectives for a unit or 
module diagnoses student needs by determining which objectives in the unit the students 
have already mastered and which they have yet to learn. In a totaljy individualized 
program, each student would be given instruction only on the objectives which he did 
not know. If a student showed mastery of all of the objectives in the unit, he would 
move on to a different unit and would take another pretest. 

The pretest data could also be used to bring together students who had similar 
needs or showed the same degree of mastery. That is, pupils would be grouped on the 
basis of the objectives they knew or did not know. 

In a group-paced program where the majority of students had mastered the 
objectives, the teacher would go on to another unit, making special provisions for any 
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students who did not know the objectives. 

A pretest might include items on prerequisite objectives. It would thus indicate 
whether the pupils were ready to learn the objectives in the new unit. 

Curriculum Embedded Test — The curriculum embedded test (GET) tells how the 
student is progressing through the unit — whether he is learning from the instruction he 
is receiving. The CET could be a quick quiz on material just taught, it could be a 
single item or measure given informally by the teacher, or it could be a practice 
exercise that the pupi! scores himself. If a student did not pass the short curriculum 
embedded tests, the teacher would wont to give him more detailed diagnostic tests. 
These might lead to instruction on prerequisites or to another mode of instruction for 
the same objective. Poor group results on CET's might affect the pace of instruction or 
prompt the teacher to use alternate methods or materials for the entire group. 

Unit Posttest — The unit posttest samples all of the important criterion objectives 
in the unit and is used to determine whether or not students have mastered or met the 
performance standards for the unit objectives. 

The posttest results will indicate whether there are students who need to repeat 
the unit before going on to another. Repetition with an individualized or multibasal 
approach would not mean doing the same things over ngain but rather working on the 
same objectives with alternate methods ond/dr materials. 

In a situation where instruction is adapted to meet student needs as shown by pre- 
tests and curriculum embedded- tests, there should be no failures on posttests. This 
assumes that the student would be given enough time to master skills at his own pace 
and that if he were unsuccessful with one mode of .instruction, alternative methods 
would be available. 
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When fhere are failures on posfl-esh, a number of questions can be asked. Some 
of these concern the tests used; some refer to the instruction itself. Here are some 
questions for the teacher, the reading specialist, and the curriculum planner: 

1 . Were students who received very low pretest scores or who 
failed to show progress on the CET's given tests on pre- 
requisite objectives? 

2. Was attention given fo individual scores on CET's, and was 
acVion taken on negative results? 

3. Was instruction on GO*s broken down into steps small enough 
to facilitate mastery? 

4. Was there flexibil ity so that children learned the GO*s in 
any order which seemed logical to them, and was there 
recognition that the child's learning style will influence 
his concept of what is logical order? 

5. Was sufficient practice provided, and was the practice relevant 
to the behavior called for in the objective? 

6. Were the learning opportunities provided appropriate to the 
interests, developmental levels, and experience of the learners? 

7. Did students get feedback on test results, and were they re- 
inforced by recognition of their success in achieving objectives? 

8. Did the items developed to test for mastery on the pretest, 
CET's, and posttest really measure the behavior called for in 
the objectives? 

9. Was instruction varied or intensified on the basis of the CET's 
that showed some students were failing to achieve mastery? 

Retention test — A retePwtion test covers all or some of the criterion objectives on 

which a student has had instruction earlier in the school year. Its purpose is to check 

on the maintenance of skills, to find out how well the student has remembered what he 

had once learned. A retention test must follow a posttest given immediately after 

instruction if it is to produce information on remembering. 
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Test scores that showed loss of achievement on objectives once attained would 
be reason for providing review on previously learned material. This might be given to 
selected individuals or to an entire group depending on the extent of need and the 
instructional model. 

Survey Posttest — A survey posttest covers all of. the important criterion objectives 
for the course. Results tell which units students mastered and which they did not 
master. Results of a survey posttest might be used to determine whether a student will 
progress to the next level of the curriculum. Use of survey posttest results for this purpos 
would most likely occur with group-paced rather than individualized instajction for in 
the latter the student would be moving from level to level at his own pace. 

Us ing Test Data for Decisions on Instruction and Curriculum 

The above descriptions have focused on the use of various types of test data for 
decisions about students. The same test data can be used to make decisions about* 
instructional practices. To reach decisions about the effectiveness of particular 
materials or methods of teaching, one would have to pool the data for individuals. 
Any one of the six test types might be used for assessing instruction. A series of curricu- 
lum-embedded tests given to children using different exercises to learn specific generic 
objectives might determine which of these exercises were most effective. For example, 
one might find out if tracing sandpaper letters aided the child's learning the alphabet. 
Tests of greater scope such as survey posttests would be appropriate fof examining 
broader aspects of instruction such as the effectiveness of a phonics approach to decod- 
ing. Collecting data on pupil characteristics would add to the utility of findings on 
instruction. 
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Pretest and posttest data are helpful in CBsessing the adequacy of the curriculum. 
If, for example, an objective were consistently achieved on a pretest, one could con- 
clude that instruction was unwarranted at the level to which the objective had been 
assigned. The objective might be reassigned to a lower level or deleted from the 
curriculum. Low pretest and posttest scores on an objective would suggest that the 
objective occurred too early in the curriculum or that the instruction was inadequate. 

It different objectives were used for different groups of pupils in the early stages 
of the reading curriculum, survey tests given at more advanced stages of the curriculum 
could be used to determine the lasting effects, if any, of the early learning. It might 
be, for example, that students who were required to know the rules for short and long 
vowels did no better than pupils who had not learned them when it came to reading 
comprehension at the end of elementary school. 

Test Item Construction 

Having seen how many types of tests can be used in the reading program, we now 
turn briefly to procedures for constructing test items using criterion and generic objectives. 

The first steps in test construction occur when generic objectives are selected and 
clustered into criterion objectives and when content elements are identified for the GO's. 
These materials — the CO, the associated GO's, and the content elements — provide the 
basis for the development of a table of specifications for a test. 

Table 6.2 is an example of specifications table for a test of a single CO: Con- 
sonants, Final: Substitution. 
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Table 6.2 



Specificafions f^r a Test* on 
Criferion Objecfive 091 
Consonanfs, FinrH? SubsHfufion 

Level 1 



Criterion 


Generic 


Content 






ObjecHve 


Objectives 


List 


Inputs 


Mastery 


091 


2-2-2-7 


1-1 


.2 






2-2-2-6 


• 3-1 


6 






2-2-2-5 


3-1 


4 


80% of al 1 




2-2-2-4 


1-1 


2 


items correct 




2-2-2-3 


1-1 


2 


(16 out of 20) 




2-2-2-2 


1-1 


2 






2-2-2-1 


1-1 


2 










20 





The firsf col'jmn of fhe specificafions fable gives fhe number of fhe criferion 
objecfive on final consonanf subsfifufion; if could be one of a sef of CO's making up a 
unif on final consonanfs. The second column iisfs fhe numbers of fhe GO's selected 
for fhis criferion objecfive. The "Confenf Lisf" column shows fhe numbers of fhe final 
consonanf Iisfs in SPPED Resource 5002 whic^i provide confenf for the GO^s and fhus 
for fhe fesf ifems. The "Inpufs" column showo how many fesf ifems are fo be included 
for each GO; fhe variafion in fhe number of inputs for fhe individual GO^s reflecfs 
fhe weighting or relative importance of each GO. Finally, fhe "Mastery" column 
shows the performance standard for fhe criterion objecfive. In fhis case, 80% or 16 out 
of 20 items must be answered correctly. These specifications for fhe number of inputs 
and the level of mastery would have been drawn from a sampling criterion objective 
for fhe CO cluster. 
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Three GO*s cited in the specifications table demonstrate how a test might cover 
oral stimuli and oral responses as well as paper and pencil items. 

GO Stimulus Mode Response 

2-2-2-2 Given a word, the student says the name Visual 

of the final consonant. (Printed word) Spoken 

2-2-2-4 Given orally a word^ the student designates Written 
another word with the same final consonant. Oral (Marking) 

2-2-2-5 Given a word and given orally a final Visual 
consonant, the student substitutes the fir?al and 
consonant and says the word formed. Oral Spoken 

List 1-1, which may be used for five of the seven objectives, is actually a group 

of lists, each of which contains words ending with the same consonant. As this is a 

level 1 list, the words are appropriate for a beginning reader. An excerpt from list 1-1 

follows in table 6.3. 

Table 6.3 

Excerpt from List 1-1 
Words Sublisted by Final Consonants 



b 


d 


f 


g 


t 


job 


bed 


if 


egg 


rabbit 


tub 


sled 


leaf 


rag 


boat 


sob 


wood 


beef 


big 


foor 


cab 


rod 


chief 


dog 


cat 


rib 


wind 


of 


frog 


bat 


web 


need 


calf 


flag 


goat 



The above words become the content elements for the test items. For example, 

a test item for GO 2-2-2-2 mSght read: 

Teacher: "Listen to this word, and say the name of its 
final consonant: sled, sled." 

Student: "Dee." 
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The teacher could, of course, use a level 1 word from any source she chose. 

The second Si:^ cifed in fhe specifications fable is composed of word "families," 
WsH of words that are fhe same except for their final consonants. Two such word 
families from list 3-1 are shown below in table 6.4. 



Table 6.4 

Excerpt from List 3-1 
Word Families for Final Consonant Substitution 



bi_ 


sa 


bib 


sad 


bid 


say 


big 


Sam 


bin 


sap 


bit 


sat 



A test itm for GO 2-2-2-5 might read as follows: 

Teacher: "Look at the word on your paper (big), and 
listen to the letter I say. Then change the 
final consonant in the word on your paper to 
the letter I name, and say the new word. 
The letter is tee, tee. Say the new word." 

Student: "Bit." 

A complete specifications table for a pretest or posttest would cover all of the 
objectives in the unit of instruction. In the preparation of such a table, the test 
designer might decide that some of the objectives that had been used for instructional 
purposes need not be tested. Generic objective 2-2-2-1 which requires the student to 
respond to a word by saying another word with the same final consonant, for example, 
might be regarded as a less difficult variation of GO 2-2-2-4 which requires the 
student to listen to a word and then select from two or more printed words the one with 



105 



the same final consonant*. The latf-er GO, 2-2-2-4, would appear on the test; the 
first cbjective, 2-2-2-1, would not. 

Comprehensive Achievement Monitoring 

Most of the test types previously described — survey testing, unit testing, pre- 
testing, posttesting, and retention testing — can be combined in a single design through 
Comprehensive Achievement Monitoring or CAM. CAM is a computerized evaluation 
system with a number of different computer programs for test design, test scheduling, 
and reporting results at the student level, the classroom level, and the program and 
curriculum level. The CAM design described here applies the principle of sampling ro 
test items and examinees. 

The Item- Examinee Samp ling Design 

The "item-examinee" sampling design involves periodic administration of a set 
of tests or test forms which cover all of the objectives of a course but which are so 
constructed that each test or test form covers only a portion or sample of those 
objectives. The test schedule is so arranged that at any test administration, each test 
form is taken by some of the students — a sample of the examinees. At the completion 
of the test schedule each student will have taken every form of the test and will have 
been tested one or more times on every objective. 

For example, consider a unit testing situation where there are 30 students in a 
course to be given pretests, then instruction, and then posttests on 10 objectives. 
Instead of giving each pupil 40 test items on the pretest (4 items per objective), we 
will randomly assign the test items to two forms, 20 to each form. On the pretest. 
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each pupil will receive one of the test forms on a random basis; the remaining test form 
will be received at the posttest period. When all individual data for thr^ pretest period 
are combined, there will be an estimate of performance on all 10 objectives; likewise 
for the posttest period. No student will have received the same test items twice, and 
no student will have received more than two test items per objective on either test 
occasion. Obviously, the individual student test data for a single objective would be 
somewhat tenuous at either test point, but some quick arithmetic indicates that group 
performance on an objective at either test occasion is based on a total of 60 responses 
(15 students X 2 Items for test form 1 + 15 students X 2 items for test form 2 at the pre- 
test or posttest points). 

This item-examinee sampling design is applicable where student performance 
data will be used for periodic rather than day-to-day decision making; for example, 
where decisions would be made once in two or three weeks. Content or item sampling 
is also appropriate where passing or failing a GO or CO would not depend on the 
student's knowing particular content. This is the case for many comprehension 
objectives. Comprehension of a particular word or passage may be of little interest to 
the reading teacher; what is important is the extent of the student*s comprehension as 
demonstrated by his performance on samples from a large pool of words and selections. 

D emons traHon of Item-Examinee Sampling 

Growth in reading vocabulary is a goal which lends itself very well to a demon- 
stration of the item-examinee sampling design. Appropriate test items for vocabulary 
acquisition would be derived from the generic objectives shown below with their 
CO descriptors: 
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CO 149; Sight Vocabulary 

3-1-49 Given a word from a familiar book, 
the student reads it orally. 

CO 147 Word Knowledge; Using and Defining Wo rds 

3-1-13 Given a familiar vord, the itudent 
writes a sentence using it. 

3-1-14 Given a familiar word, the student 
says a sentence using it. 

3-1-15 Given a familiar word, the student 
writes its meaning. 

3-1-16 Given a familiar word, the student 
designates its meaning. 

3-1-17 Given a definition, the student writes 
the word defined. 

3-1-18 Given a definition, the student designates 
the word defined. 

Suppose that the first half of an advanced basal reader introduces 400 new words. 
If an appropriate test item were written for each word, one would have a pool of 400 
test items. 

Now consider that the first half of the basal reader is to be used from the open- 
ing of school in September through the end of January. In this semester of approximately 
21 weeks, one could have 10 test administrations, one at the end of every 10 days of 
instruction. 

With a schedule of 10 test administrations, the pool of 400 test items could be 
randomly divided into 10 different test forms with 40 items each as shown in 
f Igure 6.3. 
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Figure 6.3 

Sampling of Vocabulary Items 
for Test Form Development 




Test Forms 

R ^ Random assignment of items to test forms 
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Finally, consider that there are 30 pupils in each of several classes and that every 
pupil is to be tested 10 times in the semester. With 10 different test forms, each pupil 
could have a different test form at each test administration and would eventually be 
tested on all 400 vocabulary ifems. In a given class, three students would take the same 
test form at any one test administration. Because of the random assignment of test forms, 
no two students should have the same sequence of test forms for the semester. How test 
form order would vary is demonstrated by the test schedule for one class shown in part 
in table 6,5. 

Table 6,5 

Assignment of Test Forms for Vocabulary Acquisition 
September 15 - January 31 



"^est Forms by Test Administrorion 



Student 


1 


2 


3 


4 


5 


6 


7 


8 


9 


jO 


1 . Mary Adams 


3 


10 


4 


1 


2 


7 


9 


8 


6 


5 


2. John Burke 


10 


2 


1 


4 


7 


9 


8 


6 


5 


3 


3. Peter Cayce 


6 


2 


3 


1 


5 


4 


7 


8 


10 


9 


• 
• 

30. Helen Zeno 


5 


8 


7 


2 


1 


4 


10 


9 


3 


6 


Uems per form 


40 


40 


40 


40 


40 


40 


40 


40 


40 


40 


Cumulative items 






















per student 


40 


80 


120 


160 


200 


240 


280 


320 


360 


400 


Total Items 






















Tested 


400 


400 


400 


400 


400 


400 


400 


400 


400 


400 



Cumulative 
Responses per 

Class 1200 2400 3600 4800 6000 7200 8400 9600 10800 12000 



no 



According fo this schedule, Mary Adams geh form 3 at the first test administration, 
for^n (0 at the second, and so on. In other words, Mary get?^> a different sample of 40 
words on a test every two weeks. The figures after "Cumulative Items per Student" in 
table 6.5 show that the "Total Items Tested" at each administration was 400 or the 
entire pool . 

We have asserted that CAM could accomplish several types of testing at the same 
time. The truth of this will be demonstrated by a further look at the vocabulary acquisi- 
tion test. Assuming that the 400 new vocabulary words were introduced gradually 
through the semester, the first test administration would be largely a pretest; only items 
on words taught in the first two weeks of school could be considered a posttest. There 
would be no retention testing until the second test administration when some time would 
have elapsed since the initial instruction. With each successive test administration, 
fewer and fewer items would be classified as "pretest," and more and more items would 
be labeled "retention test." The proportion of Items that could be called "posttest" 
would probably remain relatively constant if the new words were distributed equally 
through the basal reader. Tliis shift from pretest to posttesting would occur on individual 
test forms as well as on the ten forms combined. The relationship between pre-, post-, 
and retention testing on the vocabulary acquisition test is shown in figure 6.4. The 
letters in the segments of instruction below the time line represent the new words taught 
between test administrations. The numbered boxes represent the test administrations 
themselves . 

A single administration of one of the item-examinee sampling test forms for 
vocabulary acquisition would not produce diagnostic data of immediate use for a given 
individual . Any one form tests only 10 percent of the total new vocabulary for the 
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semester, and only a small proportion of the items on a given form refer to, or "post- 
test, " the vocabulary content most recently taught. Similarly only a small proportion 
of the items pretest the words to be taught before the next test administration. 



Figure 6.4 

Pretesting, Posttesting, and Retention 
Testing in an Item-Examinee Sampling Design 
With 10 Administrations of a Test 
for Vocabulary Acquisition 



• • • • 9 . • Time • o . ^ • -^^^ 
Segments of Instruction 




= Pretesting [Post | = Posttesting 



= Retention 
Testing 



The sampling approach is useful where decision making on the individual student 
level does not have an immediate, reactive, or day-to-day character. Moreover, the 
sampling approach has certain advantages such as brevity of testing and the ability to 
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generate large amounts of t^ata useful for decision making above the individual student 
level. This was demonstrated in table 6.5 where it was shown that on each vest admin- 
istration all 400 vocabulary items would be tested. With three children in a class of 
30 taking each form of the test, there would be a total of 1200 responses on the 
vocabulory items at each testing. This amount of data would have been attamed with 
at most 15 to 20 minutes of testing per student. In the course of the semester, one 
would attain a grand total of 1i:,000 responses for the class. With several classes, the 
number of responses would be many times greater. 

Reporting Results with an Item-Examinee Sampling Design 

One way of reporting the results of CAM sampling tests is to show the proportion 
of correct responses to items on a given objective. Table 6.6 is a matrix of such data 
for a test in which there were several items for each of six objectives. (The situation 
in this example is somewhat different from the previous vocabulary test demonstration 
where the acquisi^5on of each new word was an objective in itself.) 

The first column of numbers in table 6.6 lists the objectives covered by the test. 
The remaining columns siiow the percentage of correct responses per objective at each 
test administration. Test administrations are shown at the top. The data under "Tes' 
Administration T' show the results across students for each objective shortly after in- 
struction had started. The proportions of items passed on all of the objectives were 
very low so the teacher could plan on emphasizing all objectives equally. Reading 
horizontally across a row, one can follow the effect of instruction on an objective. 
The underlined percentage in a row indicates the point of instruction on the objective. 
The data on objective 100 show that performance was tow to start, with only 15 percent 
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of the items anbwered correctly; performance improved somewhat with instruction as 
shown by a rise to 30 percent correct responses at the second test administration. 
Performance reached criterion (generalized mastery) at period five and remained stable 
thereafter. 

Table 6.6 

Percentage of Correct Responses on 
Test Items Grouped by Objectives 



Test Administration 



Objective 


1 


2 


3 


4 


5 


6 


7 


100 


15 


30 


35 


30 


85 


80 


85 


200 


10 


10 


70 


65 


60 


55 


50 


300 


5 


10 


.15 


65 


60 


65 


70 


400 


0 


0 


0 


0 


70 


75 


80 


500 


5 


7 


10 


15 


10 


65 


65 


600 


7 


9 


10 


12 


15 


0 


70 



The underlining indicates that teaching has just occurred 
for the objective. 

The performance data (proportions of items answered correctly by objective) gjven 
in figure 6.6 are analogous to the separate pretest, posttest, and retention results dis- 
cussed earlier. The administration of such tests on a non-sampling basis, it should be 
recognized, is relatively more costly in terms of the time and resources consumed. How- 
ever, the context of decision making in reading instruction often requires the more 
detailed testing exemplified by the individual pretest or posttest. The sampling approach 
discussed here is appropriate in other decision making contexts and has the advantage of 
providing f>everal types of test data at lower costs. 



ERLC 
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Practice in Reeding CAM Reports 

This brief foray into evaluation as applied in reading will be concluded by a 
limited examination of computer reports produced in CAM. Two types of reports will 
be presented with brief explanations. With them will be some exercises on the inter- 
pretations, conclus\>ns, and decisions that can be drawn from these reports. 

Figure 6.5 gives computer generated reports for two different students who took 
the same form of a CAM test on 14 reading objectives. These reports indicate that it 
was the 10th test administration and that form 8 was given to both students, Fannie 
Kinnard and Judy Harrison. 

The first summary information on the reports, "Percentage correct on all items," 
shows the proportion of correct responses on this test form. This figure would have been 
a score for pretest, posttest, and retention items if this were an earlier test administra- 
tion. However, since this was the last of 10 test administrations, the test had only 
posttest or retention items. 

The next summary information, "Percentage correct on yes items," refers only to 
items on this test form that had been previously taught. Again, because this was the 
final testing, instruction had been given on all objectives. This accounts for the per- 
centages on both "all" and "yes" items being the same on each of the students* reports— 
100 percent for Fannie Kinnard in both cases, and 24 percent for Judy Harrison in both 
cases. 

In the body of the reports, the two columns on the left list the objectives by 
number. Eleven objectives are listed twice showing that there were two test items for 
each of these objectives. The plus (+) and minus (-) signs next to the objective 
numbers show whether or not the test items were answered correctly. The "Yes" entries 
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Figure 6. 5 

Examples of Student Keports 
Generated by Computer 

************************************************ 



KINNARD FANNIE 63421 SFXJU 6 MR. JOflES* 



* 
















* 


* 




TEST ADM 10 - 1/23/82 








FORM 


8* 


•PERCENTAGE 


CORRECT ON ALL ITEMS 


IS 


100 






* 


♦PERCENTAGE 
* 


CORRECT ON YES ITEMS 


IS 


100 






* 
* 


* 










TEST 


PCT COR 


PCT COR 


* 


* OBJ 


A 


INS 


OBJ A INS 




ADM 


TOTAL 


YES 


* 


Ml 01 


+ 


YES 


5501 + YES 




1 


12 


66 


* 


Ml 02 


+ 


YES 


5501 + YES 




2 


15 


65 


* 


Ml 03 


+ 


YES 


5502 + YES 




3 


20 


75 


* 


*5101 


+ 


YES 


5502 + YES 




4 


35 


90 


* 


*5101 


+ 


YES 


5601 + YES 




5 


50 


100 


* 


*5102 


+ 


YES 


5601 + YES 




6 


45 


30 


* 


*5102 


+ 


YES 






7 


65 


95 


* 


*5201 


+ 


YES 






8 


75 


95 


* 


*5201 


+ 


YES 






9 


90 


100 


* 


*5202 


+ 


YES 






10 


100 


100 


* 


♦5202 


+ 


YES 












* 


*5301 


+ 


YES 












* 


*5301 


+ 


YES 












* 


*5302 


+ 


YES 












* 


*5302 


+ 


YES 












* 


*5401 


+ 


YES 












* 


*5401 


+ 


YES 












* 


*5402 


+ 


YES 












* 


^'54 0 2 


+ 


YES 












* 



♦ HARRISON JUDY 


63414 




SECTN 


6 MR. JONES 


* 
* 


* 




TEST 


ADM 10 - 


1/23/82 








FORM 8 


* 


♦PERCENTAGE 


CORRECT ON 


ALL ITEMS 


IS 


24 






* 


♦PERCENTAGE 


CORRECT ON 


YES ITEMS 


IS 


24 






* 
* 


* 












TEST 


PCT COR 


PCT COR 


* 


♦ OBJ A 


INS 


OBJ 


A INS 




ADM 


TOTAL 


YES 


* 


♦4101 




YES 


5501 


- YES 




1 


4 


0 


* 


♦4102 


+ 


YES 


5502 


- YES 




2 


2 


45 


* 


♦4103 


+ 


YES 


5502 


- YES 




3 


10 


50 


* 


♦5101 




YES 


5601 


" YES 




4 


10 


40 


* 


♦5101 




YES 


5601 


> YES 




5 


15 


35 


* 


♦5102 




YES 








6 


15 


30 


* 


♦5102 




YES 








7 


15 


25 


* 


♦5201 


+ 


YES 








8 


20 


25 


* 


♦5201 


+ 


YES 








9 


25 


30 


* 


♦5202 




YES 








10 


24 


24 


* 


♦5202 




YES 
















♦5301 


+ 


YES 














* 


♦5301 




YES 














* 


♦5302 




YES 














* 


♦5302 




YES 














* 


♦5401 




YES 














* 


♦5401 




YES 














* 


♦5402 




YES 














* 


♦5402 




YES 














* 


♦5501 




YES 














* 
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in the third column labeled "Ins" indicate that instruction had been given on the 
objectives. Again, because this was the final testing, there was no possibility of a 
negative entry in this column. 

The columns on the right of the individual reports show the students* results for 
all 10 test administrations. The percentages correct on all items (Total) and on those 
for which instruction had been received (Yes) are given for each test administration. 

Examine the reports for Fannie Kinnard and Judy Harrison in detail and write 

down your answers to the following questions: 

1 . What conclusions would you draw about each student in the early 
stages of learning (test administrations 1-2-3)? 



2. What conclusions would you draw about posttest performance at 
test administration 10? 



3. How well did each student progress in the course? 



4. Would the progress »ecords of each student lead to different 

decisions before the conclusion of instruction on the objectives? 



Now compare the answers you have written with the following responses: 

1 . Both Kinnard and Harrison knew little about the reeding 
objectives at the beginning of the course. 

2. Fannie Kinnard's performance at test administration 10 is maximal; 
she answered all 25 items correctly. Judy Harrison shows <j very 

low level of performance. She answered only 24% or six of the items 
correctly. 
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3. Kinnard showed adequate or good progress, doing especially well 
in fhe I offer sfages of inr>frucfion . Harrison showed a fendency fo 
gain for a while on ifems for which"" insfrucfion was given, buf her 
performance deferiorafed badly before fhe conclusion of fhe course. 

4. Kinnard's record suggesfs fhaf fhe insfruction fiffed her needs. 
Harrison's reading developmenf indicafes fhaf a defailed 
analysis should have been made of her performance fhrough furfher 
fesfing af fesf adminicfration 3 or 4. 

The final exercise for fhe chapfer involves group resulfs. Figure 6.6 shows group 
data for fhe reading otjecfives on which Fannie Kinnard and Judy Harrison were fesfed. 
These dafa were obtained by summarizing fesf results across all test forms and students 
in a class at each fesf odminisfrafion. In this case, fhe dafa for each objective are 
displayed in terms of pretest, postfest, and retention scores. The first three objectives 
are prerequisites from fhe preceding year of instruction in reading; therefore the results 
on test ifems for these objectives are always rerention scores. All other objectives are 
new — insfruction has not been given. Test ifems on these new objectives produce only 
pretest scores until instruction occurs. The first fesf administration after instruction 
gives a postfest score. All subsequent testings produce retention scores. 

Objectives 5101 fhrough 5202 were taught after the first test administration and 
therefore have pretest results on only fhe first test administration. Note that posttest 
scores for 5101 through 5202 occur only once and that the remaining scores on these 
objectives are for retention. The number of pretest and retention scores varies as a 
function of the placement of the objective at a point in time, either early or late in 
the semester. 

Now examine figure 6.6 and write down the answers to these questions: 

1 . What would you conclude about the need for instruction on pre- 
requisites (the first three objectives)? 
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Figure 6,6 



COMPREHENSIVE ACHIEVEMENT MONITORING - GROUP SUI^^RY REPORT 
PERCENTAGE OF CORRECT RESPONSES 

ORCHARD HILL ELEMENTARY SCHOOL ALL OF MR. JONES' STUDENTS 



TEST ADMINISTRATION 



PAUTCUT rrvAi in 

CUNTENT GROUP 




1 


2 


3 


4 


5 


6 


• 7 


8 


9 


10 


OdJECTIVE 4101 


PRE 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




POST 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




RETN 


90 


90 


90 


95 


85 


50 


90 


90 


90 


90 


OBJECTIVE 4102 


PRE 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




POST 


0 


0 


0 


0 


0 


0 


0 


0 


J 


0 




RETN 


85 


90 


95 


100 


100 


95 


90 


100 


90 


95 


OBJECTIVE 4103 


PRE 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




POST 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 




RETN 


98 


90 


90 


100 


90 


95 


95 


90 


100 


95 


OBJECTIVE 5101 


PRE 


40 


0 


0 


0 


0 


0 


0 


0 




0 




POST 


0 


86 


0 


0 


0 


0 


0 


0 


0 


0 




RETN 


0 


0 


82 


76 


78 


74 


76 


72 


80 


82 


OBJECTIVE 5102 


PRE 


31 


0 


0 


0 


0 


0 


0 


0 


0 


0 




POST 


0 


72 


0 


0 


0 


0 


0 


0 


0 


0 




RETN 


0 


0 


82 


88 


82 


87 


82 


74 


76 


76 


OBJECTIVE 5201 


PRE 


74 


0 


0 


0 


0 


0 


0 


0 


0 


0 




POST 


0 


80 


0 


0 


0 


0 


0 


0 


0 


98 




RETN 


0 


0 


90 


90 


80 


90 


90 


90 


90 




OBJECTIVE 5202 


PRE 


78 


0 


0 


0 


0 


0 


0 


0 


0 


0 




POST 


0 


82 


0 


0 


0 


0 


0 


0 


0 


0 




RETN 


0 


0 


90 


90 


90 


100 


90 


90 


100 


100 


OBJECTIVE 5301 


PRE 


21 


16 


20 


34 


0 


0 


0 


0 


0 


0 




POST 


0 


0 


0 


0 


66 


89 


0 


0 


0 


0 




RETN 


0 


0 


n 


0 


0 


0 


76 


82 


BZ 


78 



OBJECTIVE 


5302 


PRE 


18 


20 


20 


16 


0 


0 


0 


0 


0 


0 






POST 


0 


0 


0 


0 


42 


49 


56 


48 


0 


0 






RETN 


0 


0 


0 


0 


0 


0 


0 


0 


80 


82 


OBJECTIVE 


5401 


PRE 


10 


16 


12 


22 


26 


18 


0 


0 


0 


P 






POST 


0 


0 


0 


0 


0 


0 


58 


76 


0 


0 






RtTN 


0 


0 


0 


0 


0 


0 


0 


0 


74 


83 


OBJECTIVE 


5402 


PRE 


14 


12 


15 


20 


18 


24 


36 


0 


0 


0 






POST 


0 


0 


0 


0 


0 


0 


0 


62 


0 


0 






RETN 


0 


0 


0 


0 


0 


0 


0 


0 


78 


75 


OBJECTIVE 


5501 


PRE 


16 


38 


42 


46 


40 


36 


46 


51 


0 


0 






POST 


0 


0 


0 


0 


0 


0 


0 


0 


82 


0 






RETN 


0 


0 


0 


0 


0 


0 


0 


0 


0 


80 


OBJEC : 


5502 


PRE 


10 


14 


24 


18 


12 


24 


32 


28 


0 


0 






POST 


0 


0 


0 


0 


0 


0 


0 


0 


78 


83 






RETN 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


OBJECTIVE 


5601 


PRE 


0 


12 


10 


0 


0 


0 


0 


0 


0 


0 






POST 


0 


0 


0 


34 


16 


22 


0 


0 


0 


0 






R£TN 


0 


Q 


0 


0 


0 


0 


24 


30 


31 


26 
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2. What" decision would be made about instruction on 5101? 



3. By comparison with 5101, what decision would be made about 5201? 
Should it have been included in the course? 



4. How would you interpret the data for 5302? 



5. What decision would you make in relation to the data for 5601 ? 



Now compare your answers to questions on the group data with the answers given 
below. 

1 . Instruction on the prerequisites was not needed. 

2. This is t) pical performance for a CO ?n reading, showing adequate 
teachinp . 

3. Objective 5201 should have been deleted from the course or given 
brief review. 

4. The improved results on the last test administration suggest deloyed 
learning from outside sources. 

5. This objective needs review, required more intensive teaching to 
begin with, or should be deleted from the course. 
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Conclusion 

The process of evaluation as described in this chapter provides the teacher with 
feedback for decision making which will aid the process of instruction. It is for this 
reason that the discussion was initiated with the statement that evaluation in education 
was concerned with decision making. A test is not the beginning, middle, or end of 
instruction; it is one o^ a series of continuous checkpointfi which provide information 
for the decision maker. The process of decision making involves reading and interpret- 
ing performance data, analyzing and determining the most probable cause of the 
performance, and then selecting from among a number of alternatives that which is 
likely to aid the performance. Some people call this "diagnosis and prescription," and 
diagnostic-prescriptive teaching is the goal for reading instruction. 
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Appendix A 
SPPED RESOURCE LISTINGS AND REQUESTS 
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Resources 




SPPED RESOURCE LISTINGS AND REQUESTS 



Robert P, 0 »Relliy 
Project Director 



Project Staff 



Ruth Salter 
Howard Berkun 
Gerlach van Gendt 
Martha Zakis 



Reading BOIR 
Implementation 
Mathematics BOIR 
Reading BOIR 



Telephone 518 * 474-5501 



System for 




mi 



Program 



The University of the State of New York 
THE STATE EDUCATION DEPARTMENT 
Bureau of School and Cultural Research 
Aibany, New York 12224 



EvsLluatioM and Development 



ERIC 



\9Fi 
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OBJECTIVES AVAILABLE 



No« of 

Copies Objectives 
Downers Grove Mathematics 



Primary Level 
Intermediate Level 
Junior High Level 
Secondary Level 



Downers Grove Science 



Primary Level 
Intermediate Level 
Junior High Level 
Secondary Level 



Downers Grove Social Studies 



Primary Level 
Intermediate Level 
Junior High Level 
Secondary Level 



Downers Grove Language Arts 



Primary Level 
Intermediate Level 
Junior High Level 
Secondary Level 



lOX Reading Objectives 

Level 4-6 

lOX Math Objectives 

Level K-3 

Hopkins Mathematics 



Level 3-4 
Level 5 
Level 6 
Level 8 
Level 9 

Level Geometry 
Level Algebra II 
Level Senior M.ath 



No« of 

Copies Objectives 
Harrigans Mathematics 



Level 9 
Level 11 
Level 12 



Greece Mathematics 

All Levels 

NYSED Mathematics 



Level K-4 
Level 5 
Level 6 
Level 7 
Level 8 
Level 9 
Users Manual 

Content Classification System 



Brentwood Mathematics 

Level 6 

Guilderland Mathematics 
Level K-8 

NYSED Reading (Special Request 
form necessary) 



SPPED Resource 5000: 
Generic Objectives 
(All levels) 

SPPED Resource 5001: 
Criterion Objectives 
(All levels) 
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TRAINING MATERIALS AVAILABLE 

No. of 

Copies Manuals 

Training Manuals 

0200-Needs Analysis 

' O400-Concept of Behavioral Objectives 

0600-Understanding the Kinds of 

Objectives in SPPED 

0800-Selection of Objectives 

lOOO-Modif ication of Objectives 

■ 1200-CIassification of Objectives 

1400-Instructional Models 

1600-Structuring Objectives for Course 

Development 

18CJ-Relation of Objectives to Instructional 

Model s 

2C00-Impact of CAM on CO»s 

2200-Teacher Codes CO»s 

2400-Choosing Course Curriculum 

2600-Criterion Referenced Testing 

2800-Introduction to CAM 

3000-Application of CAM to Decision Making 

3200-How Does CAM Relate to Course Structure 

3400- Summary of CAM 

3800-Specif ications for CAM Tests 

4200-Construction of Achievement Tests 



Training Reports 

Teacher Simulation (Educational Decision-Making Simulation) 

Parent Simulation-An Introducation to CAM: i'arent Learning Module 

Using CAM in the Classroom by Mary Alice Wilson 

How to Use CAM 

What is CAM 

Selecting and Using Objectives 

Training Manual for the Use of Objectives in the Bank of Objectives, Items, 

and Resources in Reading 
A Self Instructional Module in the Goals Process 

Self Instructional Module for Learning: The Hutchinson Method of Operation- 

alizing a Goal or Intent 
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TECHNICAL PAPERS 



No. of 

Copies Title 



ERIC 



Criterion Referenced Testing: No More Losers, No More Norms, 
No More Parents Raising Storms by Gene R. Hawes 

The Development of the New York State Bank of Reading Objectives 
Alternatives to Accountability 

Characteristics of Standardized Tests as Evaluation Instruments 
A Formative Evaluation for Classroom Instruction 
CAM: A Technique for Instructional Management 



RESOURCE PAPERS 

An Objective and Item Banking System: Paper-Based by Pinsky, White, & Gorth 
A Manual for a Local Paper-Based SPPED Bank 

A CMI Model for an Individualized Learning Program in Ninth Grade Science 
Project CAM Bibliography 1971 

Implementing SPPED: Services Offered by the BOCES Centers 
A Chart for Identifying Decisions Related to Student Progress 
and Program Evaluation 

The SPPED Bank of Reading Objectives: A Brief Description 
Guidebook for Teacher Use in Individualizing Instruction Through 
Use of Unipacs 



MISCELLANEOUS 

A Brief Description of SPPED 
SPPED Installations 

Outline of 145 Goals of Elementary School Education 



DOCUMENTATION 

SPPED Computer Programs and Documentation (A Short Description) 
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SPEED RESOURCE REQUESTS 

Date 



District Legal Name 

Distrj-ct Popular Name 
(if different) 

Contact Person 

Address 

Phone 

Intended Use 



As our supplies are limited some requests may not be filled » 
Please indicate your request and return to: 



Bureau of Sch^^i and Cultural Research 
M-irw York State Education Department 
Room 481 , Annex 
Albany, New York 12224 



ERIC 



129 



Appendix B 
THESAURUS 



ERIC 



^ 131 



r 



THESAURUS 



Allograph: 
Cardinal number: 

Category: 

Class: 
Complete: 



A letter or a combination of letters in a particular shape. 

A number, eo^o, I, 3, 8^ which is used in simple counting and 
which indicates how many elements there are in an assemblage, 

A group or set sharing the same characteristic[s]o Used inter- 
changeably with Class. 

See Category o 

To finish an incomplete stimulus by supplying what is missing. 
Used in conjunction with other indicators, e<,go, "Given orally 
the first part of a sentence about wishes, the student completes 
and says the sentence^ " 



Common environmental. An ordinary sound, other thjn the human voice, that one 
nonspeech sounds: might encounter in the home, r ^ighborhood, or school, e.g., 

the sound of a vacuum cleaner, doorbell, airplane, dog 

barking o 



Consonant blend: 
Consonant digraph: 

Copy: 
Designate: 



Determiner: 



See Consonant digraph, 

A combination of consonants which frequently occur together 
within a syllable, e.go, bl, grj» th, cho No distinction is 
made between consonant blends and consonai.^ digraphs^. 

To reproduce a given stimulus with the model present. 

To circle, underline, cro^s out, or mark in some way, one or 
more of a finite number of choices, leaving a physical record 
of the choice. Usually implies a condition where a numbjr of 
choices are given. The condition might be a multiple choice^ 
true/false item, or a sentence or paragraph on which the stu(3ont 
mokes physical marks » Designate may also mean to mark two or 
more items to show orde?*. 

A word belonging to a group of limiting ncxin modifiers which 
includes articles, e.g., a, the; demonstratives, e.g., this, 
that; possessives, e.g., his, Jane's; and other resi'rictlve words, 
e.g., any, both, no, several. A"?eterminer occurs before a 
descriptive adjective as in "that green house. " 



Diphthong: 



See Vowel digraph 
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Familiar: 

Flash presentation: 
Hetcronym: 

Homonym: 

Homophone: 

lliustratt on: 
Incomplete: 

Inflect! on: 



Kn 



own: 



Letter combination: 

List of words: 
Locate: 

Mulrt -meaning word: 
New: 



Previously presented in the instructional sequenceo 

A short visual exposure of a word, phrase, or sentence 
written on a card . 

One of two or more words spelled the same but pronounced 
differently and having different meanings, e.g., cfentract, 
contr&ct, boss, bosSo 

One of two or more words spelled the same and pronounced 
the same, but having different meanings, e,go, a pool of 
water, a game of pool o A homonym is one kind of homophone. 

One of two or more words which are pronounced the same but 
differ in spelling and/or meaning, epg^, so, sew; to, too, two; 
pool , pool o 

A stylized rendering of an object. 

Having an element missing. An incomplete sentence or phrase 
might have a word or words missing; an incomplete word would 
have a letter or letters missing, 

A word endina, e,g,, ed, ing , s indicating case, gender, 
number, tense, person, mood, or voice; any change in the 
form of a word that indicates a distinction of case, number, 
tense, etc; e.g«, a word with an ending such as rained , rain- 
jn£, pots; an irregular past tense as sang; an irregular plural, 
as geese. 

See Familiar , 

Two or more letters together which are not consonant or 
vowel digraphs, e.g., ah,£a, rrn. 

See Word ^^t. 

To search for an obj ;ct and point to it, e.g., to locate a title 
in the card catalog, Cf., Point to. 

A word with more than one meaning. 

Being presented for the first time in the instructional sequence, 
as in "Given a new word.** 



Number sentence: 



An equation. 
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Order: 

Ordinal number: 
Ph oneme : 

Phonogram: 

Point to: 

Print: 
Say: 

Say things about: 
Selected word list: 
Selec tion: 

Specified, specific: 

Spell: 

Tell: 

Verb agent: 
Vowel controller: 
Vowel digraph: 
Word lis): 



To place in a predetermined sequence or hierarchy* 

A number designating the position of an item in an ordered 
sequence, e.g., first, second, third. 

Speech sound, utterance; a member of the set of the smallest 
units of speech that serve to distinguish one utterance from 
another. 

A character or symbol used to represent a word, syllable, or 
phoneme . 

To place one's finger on an object or to use one's arm, hand, 
or finger to show direction or placement.. Cf., Locate . 

To use manuscript lettering. 

To give cn oral response. 

To describe or discuss oraily* 

An official word ijst, e.g., the Dolch list. 

Something to be read v/hich is more than one sentence in 
length. 

A stimulus or portion of a stimulus to which a student's atten- 
tion is called orally or by special marking of printed material « 

To give the letters of a word in sequence. Used with "orally" 
to indicate a spoken response; followed by writes, e<,g., 
"spells (writes), " for a written response. 

To orally give an account. 

The item or person performing the action of a verb; the noun 
formed by adding er to a verb, e.g., do, doer « 

A consonant (usually or r^) which changes the pronouncJction 
of a vowel , e.g., r in car . 

A combination of two vowels, e.g., ea, ou, oi, ewo No 
distinction is made between vowel digraphs and diphthongSo 

A written !:sr of words which is not an official list, Cfo, 
Selected word list. 
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Write: To give a short written response such as a word, a sentence, 

a letter^ a number, or a punctuation mark • Sometimes used 
wiiH the verb "lists" to indicate a series of short responses, 
e.g., "writes (lists)"; a written response may be in either manu 
script or cursive script unless the form is prescribed by the 
objective as in "the student writes [letters] in cursive." Cf., 
Write about . 

Write about: To give a written response that involves some composition 

such as describing, explaining, analyzing, and so forth, 
or a combination of these. 
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SKILL CATEGORY STRUCTURE AND 
CODES FOR READING OBJECTIVES 



137 



SKILL CATEGORY STRUCTURE AND CODES 
FOR READING OBJECTIVES 



MULTISENSORY READINESS SKILLS 001 

A. Auditory Skills . 001 001 

1. Acquire Auditory Discrimination 001 001 001 

Differentiate likenesses and differences 

in sounds 001 001 001 001 

Identify common environmental. sounds 001 001 001 002 
Differentiate directions and sources of 

. sounds 001 001 001 003* 

Distinguish among sound characteristics 001 001 001 004 

Specify the number of syllables in words 001 001 001 005 

2. E xpand Auditory Memory 001 001 002 

Listen for a serids ... 001 001 002 001 

Recall and follow directions 001 001 002 002 

Listen for specific details 001 001 002 003 

3. Reproduce Auditory Stimuli 001 001 003 

Imitate sounds ' 001 001 003 001 

Repeat oral selections 001 001 003 002 
Repeat variations in pitch, stress, and 

juncture 001 001 003 003 

4. Acquire Listening Comprehension 001 001 004 

Listen for main ideas 001 001 004 001 

Listen for details 001 001 004 002 

Identify sequence 001 001 004 003 

Interpret descriptive language 001 001 004 004 

Identify relationships 001 001 004 005 

Recognize emotions 001 001 004 006 

B. Oral Language 001 002 

1. Acquire Oral Language Skills in Semantics 001 002 001 

Utilize a vocabulary appropriate to the 
learner himself, his home and family, 
his school and play activities, his 

community and environment. 001 002 001 001 



*There are no Generic Objectives in this category. 
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Acquire Oral Language Skills In Semantics (contM .) 



Interpret, classify, and relate objecr.s, 



nictures - and snolcen wnTHc 


001 


002 


001 


002 


Utilize vocabulary appropriate to neecs 










and emotions 


001 


002 


001 


003 


Interpret r.'unber ccacepts 


001 


002 


001 


004 


Compare diverse sit aatlons 


001 


002 


001 


005 


Establish and describe sequences of 










events 


001 


002 


001 


006 


Determine cause and effect and predict 










outcome 


001 


002 


001 


007 


Use new words 


001 


002 


001 


008 


Relate and Interpret experiences 


001 


002 


001 


ooy 


2. Acquire Aural-Oral Language Skills In 










Phonology 


001 


002 


002 




Identify, compare, and reproduce beginning 










consonant sounds (single, blends. 










digraphs) 


001 


002 


002 


001 


Identify, compare, and reproduce final 










consonant sounds (single^ blends. 










digraphs ) 


001 


002 


002 


002 


Identify, compare, and reproduce medial 










consonant sounds (single, blends. 










digraphs) 


001 


002 


002 


003 


Identify, compare, and reproduce Initial, 










final, and medial consonant sounds 










(single , blends , digraphs) 


001 


002 


002 


G04 


Identify, compare, and reprodu::e vowel 










sounds (short, long, digraphs, dipntnongs; 


001 


UUz 


UUz 


UU J 


Identify , compare , and reproduca rhyming 










words 


001 


002 


002 


006 


3. Acquire Oral Language Skills In Syntax 


001 


002 


003 




Identify and construct substi.tutlons 










of parts of speech (nouns, verbs, pro- 










nouns, adjectives, adverbs) In simple 










sentences 


001 


002 


003 


OUl 


Identify gnd construct multiple substitu- 










tions of parts of speech (nouns, verbs, 










adjectives, and adverbs) In simple 










sentences 


001 


002 


003 


002 


Recognize and use complete sentences 










(past, present, and future forms) 


001 


002 


003 


003 


Identify and construct sentences with 










compound subjects, verbs, adjectives. 










adverbs, or pronouns 


001 


002 


003 


004 


Identify and use subordlnators and 










coordinators 


001 


002 


003 


005 
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^.L^mai J. c \jira.± ija.ngua.gti oivixxs in ^y^^ tax v, con t 












Tdsntirv PnH n<5P ■nTPrinQ'f 1"i nriQ 


001 


002 


003 


006 




Tdsntirv pnH ncA» Hp1"PTm"i tiptq 


001 


002 


003 


007 




\j w ' * *> _1_ ^ J_ y VV \j J_ o 


001 


002 


003 


008 




xuc;iLLXj.y aiiu uunb L iTuu L l ran s r o l ma u ions 




nn? 


nn*^ 


nnQ 


L 

•-r • 




nm 

\J\J X 


nn? 


nn4 






Identify and form plurals 


001 


002 


004 


001 




Use correct verb form 


001 


002 


004 


002 




Use contractions 


001 


002 


004 


003 




Use compound words 


001 


002 


004 


004 




Use positive, comparative, and super- 












lative forms of adjectives 


001 


002 


004 


005 




Use of possessive forms of nouns and 












pronouns 


001 


002 


004 


006 




Use verbs to form agents 


001 


002 


004 


007 




Use inflected endings 


001 


002 


004 


008 


Body Awareness 


001 


003 








Identify body parts, surfaces, and 












functions 


001 


003 


001 






Identify position and direction in 












space 


001 


003 


002 




Visual Skills 


001 


OOA 






1. 


Develop Visual- Perception 


001 


004 


001 






Acquire visual discrimination 


001 


OOA 


001 


001 




Develop perceptual speed 


001 


OOA 


001 


002 




Develop sense of spatial relations 


001 


OOA 


001 


003 


2. 


Develop Visual Memory 


001 


004 


002 




3. 


Develop Visualization Skills 


001 


004 


0C3 




Coo 


rdination Skills 


001 


005 








Develop e^e "tiand coordination 


001 


005 


001 
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II. DECODING SKILLS 



002 



Recognize and Use Letters of the Alphabet 


002 


001 




Recognize manuscript letters 


002 


001 


001 


Recognize cursive letters 


002 


001 


002 


Recognize alphabetical order 


002 


001 


003 


Identify vowels and consonants 


002 


001 


004 


Use Letters 


002 


001 


005 


Recognize Sound Symbol/ Symbol .Sound 








Relationships (Phonics) 


002 


002 




Identify initial sinjk,le consonants 


002 


002 


001 ' 


Identify final single consonants 


002 


002 


002 


Identify medial single consonants 


002 


002 


003 


Identify initial consonant digraphs 


002 


002 


004 


Identify final consonant digraphs 


002 


002 


005 


Iden^L'ify medial consonant digraphs 


002 


002 


006 


Identify initial consonant blends 


002 


002 


007** 


Identify final consonant blends 


002 


002 


008* * 


Identify medial consonant blends 


002 


002 


009* * 


Identify conson&nt sounds (single y 








digraphs, and blends) 


002 


002 


010 


Identify short vowel sounds 


002 


002 


Oil 


Identify long vowel sounds 


002 


002- 


012 


Identify vowel controllers 


002 


002 


013 


Identify vowel digraphs 


002 


002 


014 


Iderrify vowel diphthongs 


002 


002 


UIj^ 


Identify vowel sounds (short, long, etc) 


002 


002 


016 


Identify silent letters 


002 


002 


017 


Letter(s) /Sound Correspondence 


002 


002 


018 


Apply Rules of Spelling; and Mechanics 


002 


003 




Recognize regular spelling patterns 


r\ r\ o 

002 


UU J 




Recognize variant spelling patterns , 


002 


003 


002* 


Apply phonic generalizations 




nn Q 
UU J 


UU J 


Apply rules of punctuation and 








capitalization 


uu^ 


UU J 




Recognize the Division of Words into Units 








of Meaning (Structural Analysis) 


002 


OOA 




Identify compound words 


002 


004 


001 


Identify inflectional endings 


002 


004 


002 


Identify contractions 


002 


004 


003 


Identify abbreviations 


002 


004 


004 


Identify syllabication and word accents 


002 


004 


005 


Identify prefixes, Siif fixes, and roots 


002 


004 


006 



*There are no Generic Objectives in this category, 

**Con8onant blends are covered by generic objectives for consonant 
digraphs. See definition of consonant blend and consonant digraph In 
appendix B, 
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III. VOCABULARY SKILLS QQ3 

A. Incorporate listening and speaking 

skills into reading vocabulary 003 001 

B. Recognize and use synonyms, homonyms, 

antonyms, and heteronyras 003 002 

C. Words and Context 003 003 

D. Recognize historical origins 003 004 

E. Recognize and use nonliteral language 003 005 

F. Recognize denotation, connotation, 

and nuance 003 006 

G. Use a systematic, continuing method 

of word study to increase vocab- 
ulary 003 007^^ 



IV. COMPREHENSION SKILLS OOA 



Literal Comprehension 


OOA 


001 




Identify main ideas and major concepts 


004 


001 


001 


Find and relate details 


004 


001 


002 


Recognize sequence of ideas 


004 


001 


003 


Interpretation 


004 


002 




Understand relationships 


004 


002 


001 


Recognize cause and effect 


004 


002 


002 


Make inferences 


004 


002 


003 


Interpret figurative and descriptive 








language 


004 


002 


004 


Recognize and interpret emotional 








reactions 


004 


002 


005 


Identify and arrive at conclusions and 








generalizations 


004 


002 


006 


Compare and contrast information and 








ideas 


004 


002 


007 


Evaluate ideas and information 


004 


002 


008 


Develop critical reading skills 


004 


002 


009 


Develop oral reading skills 


004 


002 


010 


Attitude Toward Reading; 


004 


003 




Take proper caro ot reading materials 


004 


003 


001' 


Read for enjoyirent 


004 


003 


002 


Appreciate reading 


00'^ 


003 


003' 


Relate personally to reading 


004 


003 


OOA 



^^There are no Generic Objectives in this category. 
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LOCATION AND STUDY SKILLS 005 

A. Recognize and Use T extbook Aids 005 001 

Title page 005 001 001 

Copyright 005 001 002 

Format 005 001 003 

Table of contents 005 001 004 

Section and paragraph headings 005 001 005 

Italics 005 001 006 

Boldface type 005 001 007 

Index 005 001 008 

Appendix 005 001 009 

Introduction or preface 005 001 010 

Overviews 005 001 Oil 

Suimnaries 005 001 012 

Bibliographies 005 001 013 

Glossary 005 001 014 

Footnotes 005 001 015 

Pictorial and graphic representations 005 001 016 

Pronunciation keys 005 001 017 

Language abbreviations 005 001 018 

Marginal notes 005 001 019 

List of suggested readings 005 001 020 

Answer keys 005 001 021 

Etymologies 005 001 022 

B. Identify and Use Library Resources 005 002 

Organization and card catalogue 005 002 001 

Location of materials 005 002 002 

C. Identify and Use Other Sources of 

Information 0 05 003 

Dictionaries 005 003 001 

Encyclopedias 005 003 002 

Magazines 005 003 003 

Newspapers 005 003 004 

Maps and atlases 005 OGj 005 

Graphs, charts, tables, diagrams 005 003 006 

Pictures 005 003 007 

Specialized reference materials 005 003 008 

^- Use Effective Study Procedures 005 004 

Follow directions 005 004 001 

Determine appropriate sources of information 005 004 002 

Skim for general Information 005 004 003 
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Use Effective Study Procedures (cont'd) 



Read for main ideas 


005 


004 


004 


Read for details 


005 


OOA 


005 


Locate summary sentences or paragraphs 


005 


OOA 


006 


Increase reading rate 


005 


OOA 


007 


AdaDt readino^ Tatp tn n^itiiTp miTnncip 








find di "f "f "i fill tv frF TnatPTnal 


005 


004 


008 


55iiTVPV ;ind identifv nToann y a t"i nn n"F 










005 


004 


009>' 






004 


Din 


AnnrAlSP adeouacV (tF t TrFnrmat'n nti anH 








CVdXLlaUC J_UL d Li UlldL L. XL..X L. y 








dlLLl Lcxxduxxxuy 


nns 


004 


m 1 

W XX 


OTCyflTTlZP MatP'T'fal^ 
wi-^diLX4iit^ lXd^ci.XdXO 


005 


005 




Sequence information 


005 


005 


001 


Classify information according to 








identifiable rationale, criteria, 








or system 


005 


005 


002 


Write summaries 


005 


005 


003 


Take notes 


005 


005 


004^ 


Construct outlines 


005 


005 


005 


Construct charts, graphs, tables, and 








diagrams 


005 


005 


006 


Construct bibliographies 


005 


005 


007 


Construct footnotes 


005 


005 


008 


Construct tables of contents 


005 


005 


009 



Apply location and study skills to 
material of personal interest 

independent of class requirements 005 005 010* 

Utilize a personal checklist to 

evaluate progress 005 005 Oil* 



*There are no Generic Objectives in this category. 
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VI. READING IN CONTENT AREAS 

A. Reading In Literature 

Recall title, author's name, and important 
details 

Identify characters and describe 

characterization 
Describe plot and structure 
Describe setting 

Describe and discuss literary devices 

and techniqaes 
Describe and discuss symbolism and 

figurative, language 
Describe diction, usage, and tone 
Identify and describe theme 
Identify and describe genre 
Evaluate author's purpose, values, 

theme, relevance, and effectiveness 

B. Reading in the Social Sciences 

Define terminology commonly used in 

social sciences 
Recognize order and sequence 
Identify cause-and-ef f ect relationships 
Make inferences and generalizations 
Analyze problems and propose solutions 
Compare and contrast facts and opinions 
Select and read social science materials 

of personal interest 

C. Reading in Science 

Define terminology commonly used in 
science 

Identify main ideas and major concepts 

Identify details 

Recognize order and sequence 

Infer cause-and~ef f ect relationships 

Distinguish fact from opinion, 

hyp-^thesis, and theory 
Relate present reading to current 

problems 

Select and read science related materials 
of personal interest independent of school 
requirements 



006 

006 001 



006 


001 


001 


006 


001 


002 


006 


001 


r\ r\ o 

003 


006 


001 


004 


006 


UUi 


005 


006 


r\r\'\ 

001 


r\ r\ c 

UUo 


006 


r\r\'\ 

001 


007 


006 


r\r\'\ 

001 


UUo 


006 


001 


009 


006 


001 


010 


UUo 


r\ r\ o 

002 




UUo 


002 


UUi 


UUo 


n n o 
UU2 


UOZ^ 


UUo 


UUz 


UUo 


UUo 


UU/ 


UU'f 


006 


002 


005 


006 


002 


006 


006 


002 


007* 


UUO 


UU J 




006 


003 


001 


006 


003 


002* 


006 


003 


003 


006 


003 


004* 


006 


003 


005 


006 


003 


006 


006 


003 


007 


006 


003 


008* 



*There are no Generic Objectives in this category. 
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D. Reading in Mathematics 006 004 

Define terminology commonly used in 

mathematics 006 004 001 

Identify the problem 006 004 002 
Distinguish between relevant and 

irrelevant information 006 004 003^^ 

Make generala.zations 006 004 004 



*There are no Generic Objectives in this category. 
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